File size: 181 Bytes
35ba946
 
 
1
2
3
This is a LoRA of microsoft/phi-1_5 trained on the fulltext part of the EuropePMC open access subset for ~35,000 steps

Gets a final eval loss of ~2.5. Definitely a work in progress