Hugging Face's logo
AwakeningOS's picture

AwakeningOS

AwakeningOS
1
·

AI & ML interests

Small language models, efficient LLM architectures, home-GPU training, open-source model development, and AI-assisted architecture research.

Recent Activity

new activity about 4 hours ago
AwakeningOS/KaiNomos-110M:Delta Attention Residuals
reacted to Enderchef's post with ❤️ about 4 hours ago
Introducing GCI-Bench, Glint Research's first benchmark! This 5000-question bench benchmarks attention and gradients; it gives a prompt and unrelated filler parts. The goal is to benchmark if the model understands and attends to the important parts more than the unimportant parts. I've already benchmarked on the top 5 models on our Leaderboard(Glint2, Supra 50M, Glint1.3, GPT S 5M, GPT X2 125M) Pending benchmark status at https://huggingface.co/spaces/OpenEvals/README/discussions/2 https://huggingface.co/datasets/Glint-Research/GCI_Bench
updated a model 1 day ago
AwakeningOS/KaiNomos-110M
View all activity

Organizations

None yet