AwakeningOS

AwakeningOS

1

·

AI & ML interests

Small language models, efficient LLM architectures, home-GPU training, open-source model development, and AI-assisted architecture research.

Recent Activity

updated a model about 11 hours ago

AwakeningOS/KaiNomos-747M

new activity about 18 hours ago

AwakeningOS/KaiNomos-747M:Delta Attention Residuals

reacted to Enderchef's post with ❤️ about 18 hours ago

Introducing GCI-Bench, Glint Research's first benchmark! This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts. I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M) Pending benchmark status at https://huggingface.co/spaces/OpenEvals/README/discussions/2 https://huggingface.co/datasets/Glint-Research/GCI_Bench

View all activity

Organizations

None yet

AwakeningOS 's datasets

None public yet