GitHub repository: okitouni/gpt2-absorbing-state
Primary language: Python
Created: 2024-02-04T14:03:39Z
Description: Training GPT2 with an absorbing state discrete diffusion objective. Why? More data efficient.