Commit History

try turning on hosted inference
c3d9785

RonanMcGovern commited on

add much improved options for inference
2f138ab

RonanMcGovern commited on

replace GPTQ with act order false (for faster generation)
bef9c7e

RonanMcGovern commited on