Commit
•
cfef4ad
1
Parent(s):
e1f4e71
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,3 +11,4 @@ WanDB, https://wandb.ai/huseinzol05/EasyContext-262144?nw=nwuserhuseinzol05
|
|
| 11 |
|
| 12 |
Source code, https://github.com/mesolitica/malaya/tree/master/session/llama3#extend-1m-context-length
|
| 13 |
|
|
|
|
|
|
| 11 |
|
| 12 |
Source code, https://github.com/mesolitica/malaya/tree/master/session/llama3#extend-1m-context-length
|
| 13 |
|
| 14 |
+
Special thanks to https://github.com/jzhang38/EasyContext for wrapping https://github.com/zhuzilin/ring-flash-attention for distributed training!
|