AwakeningOS

AwakeningOS

1

·

AI & ML interests

Small language models, efficient LLM architectures, home-GPU training, open-source model development, and AI-assisted architecture research.

Recent Activity

updated a model about 8 hours ago

AwakeningOS/KaiNomos-747M

new activity about 15 hours ago

AwakeningOS/KaiNomos-747M:Delta Attention Residuals

reacted to Enderchef's post with ❤️ about 15 hours ago

Introducing GCI-Bench, Glint Research's first benchmark! This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts. I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M) Pending benchmark status at https://huggingface.co/spaces/OpenEvals/README/discussions/2 https://huggingface.co/datasets/Glint-Research/GCI_Bench

View all activity

Organizations

None yet

AwakeningOS 's models 1

AwakeningOS/KaiNomos-747M

Updated about 8 hours ago