This contains prebuilt binaries intended for use with KoboldCpp. They may also work on other Linux environments with Nvidia cards.

To use these binaries, try the notebook at https://koboldai.org/colabcpp