Repository: arrmansa/Basic-UI-for-GPT-J-6B-with-low-vram
Description: A repository to run gpt-j-6b on low vram machines (4.2 gb minimum vram for 2000 token context, 3.5 gb for 1000 token context). Model loading takes 12gb free ram.
Languages: Jupyter Notebook
Stars: 115
License: Apache License 2.0