How to train every expert in mixtral 8x7B on different domain data ?
#56
by
chin-cyber
- opened
hey , i want to train the mixtral model in a manner that every expert inside it will be train on a diiferent domain specofoc data, any idea how can I do it ? I am gettign all tutorials in which we are just training the entire model but i want to target soecific expert in model. How will I do that? please help