Weyaxi/Einstein-v6.1-Llama3-8B

Text Generation • Updated 5 days ago • 1.6k • 45

Note Based on the new LLama3. Full fine-tuned for 2 epochs. Version 6 included more data and changed some of the datasets that has been used in v5. Added EverythingLM-data-V3, no_robots and half of the wizardlm_evol_instruct_70k dataset. Version 6.1 removed refusals etc. to remove censorship compared to v6.

Weyaxi/Einstein-v6-7B

Text Generation • Updated 28 days ago • 1.99k • 10

Note Currently the best and stable model but it's more censored than v4. Based on the fixed version of Mistral-7B-v0.2 Full fine-tuned for 2 epochs. Included more data and changed some of the datasets I used. Added EverythingLM-data-V3, no_robots and half of the wizardlm_evol_instruct_70k dataset.

Weyaxi/Einstein-v5-v0.2-7B

Text Generation • Updated Apr 4 • 1.92k • 10

Note ⚠️ Deprecated! Based on Mistral-7B-v0.2 but fine-tuned with wrong sliding window. Full fine-tuned for 1 epochs. Included more data and changed some of the datasets I used.

Weyaxi/Einstein-v4-phi2

Text Generation • Updated 16 days ago • 1.57k • 2

Note Phi2 full fine-tuned for 2 epochs with the exact data used to train Einstein-v4-7B.

Weyaxi/Einstein-v4-7B

Text Generation • Updated Apr 6 • 4.62k • 45

Note Good and a stable model. It has been full fine-tuned for 1.5 epochs. Included more data and changed some of the datasets I used.

Weyaxi/Einstein-v3-7B

Text Generation • Updated Apr 4 • 3.85k • 1

Note New portion of data compared to v2.

Weyaxi/Einstein-v2-7B

Text Generation • Updated Apr 4 • 3.82k • 1

Note Test the model after the initial model. I have now begun to include both general data and science-related datasets in this model.

Weyaxi/Einstein-7B

Text Generation • Updated Jan 28 • 3.07k • 10

Note First model of the series. The initial idea was to train it exclusively with science-related datasets. However, I later modified this idea to prioritize having more science-related data than other existing good models.