Adds support for MQA/GQA and attention mask during training / fine-tuning.

Upload modeling_mixformer_sequential.py

Upload README.md

fix(phi-1): Checks length of `attention_mask`if it is passed as direct tensor.

Support for `attention_mask` in forward pass.

Update README.md

Upload tokenizer

Upload MixFormerSequentialForCausalLM

Update README.md

Update README.md

Update README.md

Update generation_config.json

Update generation_config.json

Update generation_config.json

Update README.md

Update README.md

Update README.md

Update README.md

Upload Research License.docx

Update README.md

Update README.md

Update README.md

Upload tokenizer

Upload MixFormerSequentialForCausalLM

Upload tokenizer

Upload MixFormerSequentialForCausalLM

initial commit