danfu09 commited on
Commit
9fbe156
1 Parent(s): b8c6bca

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -5,8 +5,8 @@ language:
5
  pipeline_tag: text-classification
6
  ---
7
 
8
- # Monarch Mixer BERT
9
 
10
- The 80M checkpoint for [M2-BERT](https://hazyresearch.stanford.edu/blog/2023-07-25-m2-bert).
11
 
12
- Check out our [GitHub](https://github.com/HazyResearch/m2/tree/main) for instructions on how to download and fine-tune it!
 
5
  pipeline_tag: text-classification
6
  ---
7
 
8
+ # Monarch Mixer-BERT
9
 
10
+ The 80M checkpoint for M2-BERT-base from the paper [Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture](https://arxiv.org/abs/2310.12109).
11
 
12
+ Check out our [GitHub](https://github.com/HazyResearch/m2/tree/main) for instructions on how to download and fine-tune it!