It depends. Most of our AI models work very well without a GPU. But the most advanced models based on text generation like
GPT-J, GPT-NeoX, and LLaMA 2 need a GPU in order to address bigger inputs and outputs, and to respond promptly. More generally, a GPU is recommended
for production use for most of our models as it considerably improves the throughput and the response time.