elinas

elinas

AI & ML interests

LLMs & Finetuning

Recent Activity

Organizations

Zeus Labs's profile picture KoboldAI's profile picture Social Post Explorers's profile picture Cognitive Computations's profile picture LLMExperiments's profile picture

elinas's activity

New activity in ZeusLabs/Chronos-Platinum-72B 2 months ago

Really really good!

1
#3 opened 2 months ago by FiditeNemini
New activity in ZeusLabs/Chronos-Platinum-72B 2 months ago
New activity in ZeusLabs/Chronos-Platinum-72B 2 months ago

Qwen 2_5 32b?

2
#1 opened 2 months ago by DazzlingXeno
New activity in ZeusLabs/README 3 months ago

This looks so good.

2
#2 opened 3 months ago by Kquant03
New activity in elinas/Chronos-Gold-12B-1.0 3 months ago
posted an update 3 months ago
view post
Post
2056
We conducted an experiment in an effort to revive LLaMA 1 33B as it had unique prose and a lack of "GPT-isms" and "slop" in its pretraining data, as well as being one of the favorites at the time. With multiple finetune runs, we were able to extend the model from it's pretrained base of 2048 to ~12,000 tokens adding approx. 500M tokens in the process. The effective length is 16,384 but it's better to keep it on the lower range. It writes well and in multiple formats. In the future, we have some ideas like implementing GQA. Please take a look and we would love to hear your feedback!

ZeusLabs/Chronos-Divergence-33B
updated a Space 3 months ago
New activity in elinas/chronos-mistral-7b 3 months ago

Upload tokenizer.json

#2 opened 3 months ago by Suparious
New activity in elinas/chronos-mistral-7b 3 months ago

no tokenizer.json?

2
#1 opened 3 months ago by Suparious