GitHub repository: Bruber92/RWKV-infctx-trainer
Description: RWKV infctx trainer, for training arbitary context sizes, to 10k and beyond!