FlashVenom
flashvenom
AI & ML interests
Exploring LLM training, inference and serving
Organizations
flashvenom's activity
Code?
2
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Really cool work
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Model details?
1
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Thanks for all the hard work! Chance to see superhot-65b?
9
#1 opened about 1 year ago
by
Panchovix
Released a 4bit GPTQ to make it easier for folks to try it out!
3
#3 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
7B, 33B and 65B versions?
3
#2 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
oobabooga Settings
2
#2 opened about 1 year ago
by
siiNCeyy
Download corrupted/Not working
16
#1 opened about 1 year ago
by
Sergei6000
Love the idea
5
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Difference between this and 8k version?
10
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Performance?
7
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Is my understanding correct that the monkey patch will be needed to be added for inference only?
5
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
4 bit GPTQ
2
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
woo
3
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
What does the 4k stand for?
2
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Prompt style?
1
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Code to train?
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Will there be other versions (ie. 7B/13B/65B)
2
#2 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Context Length?
2
#4 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Training code?
1
#3 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Dataset?
6
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Thanks for the all the great work :)
#6 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
License update?
1
#16 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Plans for other versions (outside of 7B and 40B)?
1
#26 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)
Upload pytorch_model.bin.index.json
#1 opened about 1 year ago
by
flashvenom
![](https://cdn-avatars.huggingface.co/v1/production/uploads/637c621facc078d5bec14073/MOKvlABZuesOL3rVmxalE.png)