GitHub repository: nath54/Dedale_LLM
Primary language: Python
Created: 2024-02-12T14:38:09Z
Description: This is a prototype of a MixtureOfExpert LLM made with pytorch. Currently in developpment, I am testing its capabilities of learning with simple little tests before learning it on large language datasets.