alexgusevski/openhands-lm-32b-v0.1-mlx-6Bit
Text Generation
•
Updated
•
3
Alexander Gusev
alexgusevski
AI & ML interests
Open Source, running stuff on my M4. Check out anemll-server: https://github.com/alexgusevski/anemll-server
Recent Activity
updated
a model
about 12 hours ago
alexgusevski/openhands-lm-32b-v0.1-mlx-6Bit
published
a model
about 12 hours ago
alexgusevski/openhands-lm-32b-v0.1-mlx-6Bit
updated
a collection
about 12 hours ago
MLX Models
Organizations
None yet
alexgusevski's activity
updated
a
model
about 12 hours ago
published
a
model
about 12 hours ago
updated
a
collection
about 12 hours ago
updated
a
model
about 13 hours ago
published
a
model
about 13 hours ago
updated
a
model
about 13 hours ago
published
a
model
about 13 hours ago
updated
a
model
about 13 hours ago
published
a
model
about 13 hours ago
updated
a
model
about 14 hours ago
published
a
model
about 14 hours ago
reacted to
ritvik77's
post with ❤️
12 days ago
Post
2507
Big companies are now training huge AI models with tons of data and billions of parameters, and the future seems to be about quantization—making those models smaller by turning big numbers into simpler ones, like going from 32-bit to 8-bit without reducing accuracy by +/- 0.01%. There should be some standard unit of measurement for the ratio of model size reduction to accuracy lost.
What do you all thing about this ?
What do you all thing about this ?
- 4 replies
Update to latest mlx_lm version?
1
#46 opened 13 days ago
by
alexgusevski
updated
a
collection
14 days ago