Need to use T4 GPU
#11
by
vectornaut
- opened
When running the command generations = generate_aya_23(prompts, model) I got an error because the A100 GPU is incompatible with FlashAttention. After changing the GPU to T4, and using the T4 parameters at the top, the code run.
hey @vectornaut
since you were able to kickoff training as mentioned in this thread, I'm assuming this issue is resolved?
Let me know if I can close this thread or if you still need help with this.