Aurélien-Morgan CLAUDON's picture

Aurélien-Morgan CLAUDON

Aurelien-Morgan

·

https://huggingface.co/retrain-pipelines

AI & ML interests

None yet

Recent Activity

reacted to jsulz's post with 🧠 1 day ago

What does it mean when models share the same bytes? We've investigated some quants and have seen that a considerable portion of quantizations of the same model share the same bytes and can be deduplicated to save considerable upload time for quantizers on the Hub. This space where we crack open a repo from @bartowski shows we can get significant dedupe https://huggingface.co/spaces/xet-team/quantization-dedup You can get a sense of why by reading this write-up: https://github.com/bartowski1182/llm-knowledge/blob/main/quantization/quantization.md But what about finetuned models? Since going into production the https://huggingface.co/xet-team has migrated hundreds of repositories on the Hub to our storage layer, including classic "pre-Hub" open-source models like https://huggingface.co/FacebookAI/xlm-roberta-large (XLM-R) from https://huggingface.co/FacebookAI XLM-R, introduced in 2019, set new benchmarks for multilingual NLP by learning shared representations across 100 languages. It was then fine-tuned on English, Spanish, Dutch, and German, generating language-specific derivations for each - check out the paper here https://huggingface.co/papers/1911.02116 These finetunes share much of the same architecture and layout as XLM-R with similar training methods and goals. It makes sense that they would share bytes, but it's still fascinating to see. We put together a similar space to explore these models to see where they overlap - check it out for yourself https://huggingface.co/spaces/xet-team/finetune-dedupe The darker each block in the heatmap, the more the bytes are shared. Clicking on a repos blocks shows all other repos that share blocks.

upvoted a paper 1 day ago

SmolVLM: Redefining small and efficient multimodal models

new activity 4 days ago

blog-explorers/README:Preview dark/light toggle

View all activity

Organizations

Posts 3

Post

1956

Almost there !
https://test.pypi.org/project/test-010-retrain-pipelines/

Articles 1

Article

4

Fancy Stateful Metaflow Service + UI on Google Colab ?

View all Articles

models

None public yet

datasets

None public yet