GitHub repository: sanjeevanahilan/nanoChatGPT
Primary language: Python
Description: A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick