| language: | |
| - ms | |
| # Pretrain SMALL 512 masking context length T5 on Malaysian text | |
| README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/nanoT5 | |
| WandB, https://wandb.ai/huseinzol05/nanoT5-small?nw=nwuserhuseinzol05 |
| language: | |
| - ms | |
| # Pretrain SMALL 512 masking context length T5 on Malaysian text | |
| README at https://github.com/mesolitica/malaya/tree/5.1/pretrained-model/nanoT5 | |
| WandB, https://wandb.ai/huseinzol05/nanoT5-small?nw=nwuserhuseinzol05 |