DevQuasar/allura-org.Teleut-7b-GGUF
Text Generation
•
Updated
Csaba Kecskemeti PRO
csabakecskemeti
AI & ML interests
None yet
Recent Activity
updated
a model
13 minutes ago
DevQuasar/allura-org.Teleut-7b-GGUF
updated
a model
about 2 hours ago
DevQuasar/MTSAIR.Cotype-Nano-GGUF
updated
a model
about 4 hours ago
DevQuasar/Nexusflow.Athene-V2-Agent-GGUF
Organizations
csabakecskemeti's activity
updated
a
model
13 minutes ago
updated
a
model
about 2 hours ago
updated
a
model
about 4 hours ago
updated
a
model
about 12 hours ago
updated
a
model
about 14 hours ago
updated
a
model
about 16 hours ago
posted
an
update
1 day ago
Post
719
I have this small utility: no_more_typo
It is running in the background and able to call the LLM model to update the text on the clipboard. I think it would be ideal to fix typos and syntax.
I have just added the option to use custom prompt templates to perform different tasks.
Details, code and executable:
https://github.com/csabakecskemeti/no_more_typo
https://devquasar.com/no-more-typo/
It is running in the background and able to call the LLM model to update the text on the clipboard. I think it would be ideal to fix typos and syntax.
I have just added the option to use custom prompt templates to perform different tasks.
Details, code and executable:
https://github.com/csabakecskemeti/no_more_typo
https://devquasar.com/no-more-typo/
updated
a
model
1 day ago
updated
2
collections
1 day ago
updated
a
model
1 day ago
updated
a
model
3 days ago
updated
a
collection
3 days ago
updated
2
models
3 days ago
replied to
their
post
3 days ago
Exactly :D
Overflow fridge will be replaced with a rack :)
Phi3 or Mistral?
2
#3 opened 3 days ago
by
csabakecskemeti
csabakecskemeti
liked
a
dataset
3 days ago
Reacted to
cappuch's
post with 😎
3 days ago
Post
1526
p104-100s are beasts. 8 gigs of VRAM, 12 tok/s on qwen 14b at q4, and 18 tok/s on 7b at q6. best thing - 20 euros each.
https://furry.engineer/@cappuch/113500349547803802
https://furry.engineer/@cappuch/113500349547803802
- 3 replies
posted
an
update
3 days ago
Post
265
Repurposed my older AI workstation to a homelab server, it has received 2xV100 + 1xP40
I can reach huge 210k token context size with MegaBeam-Mistral-7B-512k-GGUF ~70+tok/s, or run Llama-3.1-Nemotron-70B-Instruct-HF-GGUF with 50k Context ~10tok/s (V100 only 40k ctx and 15tok/s).
Also able to Lora finetune with similar performace as an RTX3090.
It moved to the garage to no complaints for the noise from the family. Will move to a Rack soon :D
I can reach huge 210k token context size with MegaBeam-Mistral-7B-512k-GGUF ~70+tok/s, or run Llama-3.1-Nemotron-70B-Instruct-HF-GGUF with 50k Context ~10tok/s (V100 only 40k ctx and 15tok/s).
Also able to Lora finetune with similar performace as an RTX3090.
It moved to the garage to no complaints for the noise from the family. Will move to a Rack soon :D
-
- 2 replies