I am having out of memory error while running example inference code with this model
#6 opened 10 months ago
by
yilmazay
Modeli test etmek için Spaces
3
#5 opened 10 months ago
by
tolgadev
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6045600bb79a75142576efa7/0uL6u9S-mu1eRxDOr9q0u.png)
Baz alınan model detayları
#4 opened 10 months ago
by
psychip
![](https://cdn-avatars.huggingface.co/v1/production/uploads/660841edf4ab6519014d66ad/Z3K5DOXWsI8sNVvXPjDYQ.jpeg)
Ülkemizde LLM ve yeni modeller
2
#3 opened 11 months ago
by
mertzkul
![](https://cdn-avatars.huggingface.co/v1/production/uploads/64468b55c41681efdb9daf56/BlXvu4_C10I1JGPdH3mc6.png)
Add 4-bit quantization and automatic device mapping for improved performance.
1
#1 opened 11 months ago
by
notbdq
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6566b0e05710d2cdddf92a6e/hWlRNl_zLo6hSNhng8gj3.png)