memy85
/

usmle-llama2-7b-longlora-32k

Model card Files Files and versions Community

usmle-llama2-7b-longlora-32k / README.md

memy85's picture

Update README.md

0e345c9 verified 11 months ago

|

162 Bytes

USMLE trained LLama2 7b model with long inputs

Here we use Llama2 7B model with a input size longer than the original 4096. The maximum sequence length is 32k