Elias Limouni's picture

Elias Limouni

Eliaccess

·

https://linkedin.com/in/elias-limouni/

eliaccess

AI & ML interests

IoT, Deep Learning & Optimization

Recent Activity

reacted to csabakecskemeti's post with 👍 4 days ago

The AMD Instinct MI50 (~$110) is surprisingly fast for inference Quantized models. This runs a Llama 3.1 8B Q8 with Llama.cpp https://huggingface.co/spaces/DevQuasar/Mi50 A little blogpost about the HW http://devquasar.com/uncategorized/amd-radeon-instinct-mi50-cheap-inference/

View all activity

Organizations

Eliaccess's activity

reacted to csabakecskemeti's post with 👍 4 days ago

Post

4430

The AMD Instinct MI50 (~$110) is surprisingly fast for inference Quantized models.

This runs a Llama 3.1 8B Q8 with Llama.cpp
DevQuasar/Mi50

A little blogpost about the HW
http://devquasar.com/uncategorized/amd-radeon-instinct-mi50-cheap-inference/