Introducing HUGS - Scale your AI with Open Models
β’
34
Simon Pagezy
pagezyhf
AI & ML interests
Healthcare ML
Recent Activity
posted
an
update
3 days ago
Hello Hugging Face Community,
if you use Google Kubernetes Engine to host you ML workloads, I think this series of videos is a great way to kickstart your journey of deploying LLMs, in less than 10 minutes! Thank you @wietse-venema-demo !
To watch in this order:
1. Learn what are Hugging Face Deep Learning Containers
https://youtu.be/aWMp_hUUa0c?si=t-LPRkRNfD3DDNfr
2. Learn how to deploy a LLM with our Deep Learning Container using Text Generation Inference
https://youtu.be/Q3oyTOU1TMc?si=V6Dv-U1jt1SR97fj
3. Learn how to scale your inference endpoint based on traffic
https://youtu.be/QjLZ5eteDds?si=nDIAirh1r6h2dQMD
If you want more of these small tutorials and have any theme in mind, let me know!
Articles
Organizations
pagezyhf's activity
Reacted to
Xenova's
post with π
2 days ago
Post
2097
We just released Transformers.js v3.1 and you're not going to believe what's now possible in the browser w/ WebGPU! π€― Let's take a look:
π Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
ποΈ Qwen2-VL from Qwen for dynamic-resolution image understanding
π’ JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
π LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
π€ΈββοΈ ViTPose for pose estimation
π MGP-STR for optical character recognition (OCR)
π PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! π₯ Huge for privacy!
Check out the release notes for more information. π
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
π Janus from Deepseek for unified multimodal understanding and generation (Text-to-Image and Image-Text-to-Text)
ποΈ Qwen2-VL from Qwen for dynamic-resolution image understanding
π’ JinaCLIP from Jina AI for general-purpose multilingual multimodal embeddings
π LLaVA-OneVision from ByteDance for Image-Text-to-Text generation
π€ΈββοΈ ViTPose for pose estimation
π MGP-STR for optical character recognition (OCR)
π PatchTST & PatchTSMixer for time series forecasting
That's right, everything running 100% locally in your browser (no data sent to a server)! π₯ Huge for privacy!
Check out the release notes for more information. π
https://github.com/huggingface/transformers.js/releases/tag/3.1.0
Demo link (+ source code): webml-community/Janus-1.3B-WebGPU
Reacted to
AdinaY's
post with π₯
2 days ago
Post
1403
π The wave of reasoning models from the Chinese community has arrived!
π Marco-o1 by AIDC, Alibaba
π AIDC-AI/Marco-o1
β¨ QwQ by Qwen, Alibaba
π Qwen/qwq-674762b79b75eac01735070a
π Skywork-o1 by Kunlun Tech
π Skywork/skywork-o1-open-67453df58e12f6c3934738d0
π₯ Xkev/Llama-3.2V-11B-cot by PKU Yuan group
π Xkev/Llama-3.2V-11B-cot
π‘ DeepSeek-R1-Lite-Preview by DeepSeek AI
π https://chat.deepseek.com/
π InternThinker Preview by Shanghai AI Lab
π https://sso.openxlab.org.cn/login?redirect=https://internlm-chat.intern-ai.org.cn/&clientId=ebmrvod6yo0nlzaek1yp
π k0-math by Moonshot AI
π https://kimi.moonshot.cn/ ( coming soon! )
Who's next? π
zh-ai-community/reasoning-models-67409fb3aa1ed78f10087cd7
π Marco-o1 by AIDC, Alibaba
π AIDC-AI/Marco-o1
β¨ QwQ by Qwen, Alibaba
π Qwen/qwq-674762b79b75eac01735070a
π Skywork-o1 by Kunlun Tech
π Skywork/skywork-o1-open-67453df58e12f6c3934738d0
π₯ Xkev/Llama-3.2V-11B-cot by PKU Yuan group
π Xkev/Llama-3.2V-11B-cot
π‘ DeepSeek-R1-Lite-Preview by DeepSeek AI
π https://chat.deepseek.com/
π InternThinker Preview by Shanghai AI Lab
π https://sso.openxlab.org.cn/login?redirect=https://internlm-chat.intern-ai.org.cn/&clientId=ebmrvod6yo0nlzaek1yp
π k0-math by Moonshot AI
π https://kimi.moonshot.cn/ ( coming soon! )
Who's next? π
zh-ai-community/reasoning-models-67409fb3aa1ed78f10087cd7
posted
an
update
3 days ago
Post
262
Hello Hugging Face Community,
if you use Google Kubernetes Engine to host you ML workloads, I think this series of videos is a great way to kickstart your journey of deploying LLMs, in less than 10 minutes! Thank you @wietse-venema-demo !
To watch in this order:
1. Learn what are Hugging Face Deep Learning Containers
https://youtu.be/aWMp_hUUa0c?si=t-LPRkRNfD3DDNfr
2. Learn how to deploy a LLM with our Deep Learning Container using Text Generation Inference
https://youtu.be/Q3oyTOU1TMc?si=V6Dv-U1jt1SR97fj
3. Learn how to scale your inference endpoint based on traffic
https://youtu.be/QjLZ5eteDds?si=nDIAirh1r6h2dQMD
If you want more of these small tutorials and have any theme in mind, let me know!
if you use Google Kubernetes Engine to host you ML workloads, I think this series of videos is a great way to kickstart your journey of deploying LLMs, in less than 10 minutes! Thank you @wietse-venema-demo !
To watch in this order:
1. Learn what are Hugging Face Deep Learning Containers
https://youtu.be/aWMp_hUUa0c?si=t-LPRkRNfD3DDNfr
2. Learn how to deploy a LLM with our Deep Learning Container using Text Generation Inference
https://youtu.be/Q3oyTOU1TMc?si=V6Dv-U1jt1SR97fj
3. Learn how to scale your inference endpoint based on traffic
https://youtu.be/QjLZ5eteDds?si=nDIAirh1r6h2dQMD
If you want more of these small tutorials and have any theme in mind, let me know!
liked
2
Spaces
4 days ago
liked
2
models
11 days ago
posted
an
update
15 days ago
Post
1350
Hello Hugging Face Community,
I'd like to share here a bit more about our Deep Learning Containers (DLCs) we built with Google Cloud, to transform the way you build AI with open models on this platform!
With pre-configured, optimized environments for PyTorch Training (GPU) and Inference (CPU/GPU), Text Generation Inference (GPU), and Text Embeddings Inference (CPU/GPU), the Hugging Face DLCs offer:
β‘ Optimized performance on Google Cloud's infrastructure, with TGI, TEI, and PyTorch acceleration.
π οΈ Hassle-free environment setup, no more dependency issues.
π Seamless updates to the latest stable versions.
πΌ Streamlined workflow, reducing dev and maintenance overheads.
π Robust security features of Google Cloud.
βοΈ Fine-tuned for optimal performance, integrated with GKE and Vertex AI.
π¦ Community examples for easy experimentation and implementation.
π TPU support for PyTorch Training/Inference and Text Generation Inference is coming soon!
Find the documentation at https://huggingface.co/docs/google-cloud/en/index
If you need support, open a conversation on the forum: https://discuss.huggingface.co/c/google-cloud/69
I'd like to share here a bit more about our Deep Learning Containers (DLCs) we built with Google Cloud, to transform the way you build AI with open models on this platform!
With pre-configured, optimized environments for PyTorch Training (GPU) and Inference (CPU/GPU), Text Generation Inference (GPU), and Text Embeddings Inference (CPU/GPU), the Hugging Face DLCs offer:
β‘ Optimized performance on Google Cloud's infrastructure, with TGI, TEI, and PyTorch acceleration.
π οΈ Hassle-free environment setup, no more dependency issues.
π Seamless updates to the latest stable versions.
πΌ Streamlined workflow, reducing dev and maintenance overheads.
π Robust security features of Google Cloud.
βοΈ Fine-tuned for optimal performance, integrated with GKE and Vertex AI.
π¦ Community examples for easy experimentation and implementation.
π TPU support for PyTorch Training/Inference and Text Generation Inference is coming soon!
Find the documentation at https://huggingface.co/docs/google-cloud/en/index
If you need support, open a conversation on the forum: https://discuss.huggingface.co/c/google-cloud/69
upvoted
a
collection
25 days ago
upvoted
a
collection
about 1 month ago
upvoted
an
article
about 1 month ago
Article
Inference Endpoints Changelog π
By
β’
β’
18
[FEEDBACK] Follow
4
#14 opened about 1 year ago
by
victor
victor
liked
a
Space
about 2 months ago
liked
a
Space
2 months ago
Reacted to
fdaudens's
post with π₯
2 months ago
Post
2043
IBM & NASA just released open-source AI model for weather & climate on Hugging Face.
Prithvi WxC offers insights beyond forecasting, tackling challenges from local weather to global climate. Potential apps: targeted forecasts, severe weather detection & more. https://huggingface.co/Prithvi-WxC
This is impressive. Check out this comparison of the Ida hurricane between ground truth and the AI model's prediction.
Prithvi WxC offers insights beyond forecasting, tackling challenges from local weather to global climate. Potential apps: targeted forecasts, severe weather detection & more. https://huggingface.co/Prithvi-WxC
This is impressive. Check out this comparison of the Ida hurricane between ground truth and the AI model's prediction.
liked
a
model
2 months ago
Reacted to
alvarobartt's
post with π₯
2 months ago
Post
2763
π€ Serving Meta Llama 3.1 405B on Google Cloud is now possible via the Hugging Face Deep Learning Containers (DLCs) for Text Generation Inference (TGI)
In this post, we showcase how to deploy https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 on an A3 instance with 8 x H100 GPUs on Vertex AI
Thanks to the Hugging Face DLCs for TGI and Google Cloud Vertex AI, deploying a high-performance text generation container for serving Large Language Models (LLMs) has never been easier. And weβre not going to stop here β stay tuned as we enable more experiences to build AI with open models on Google Cloud!
Read the full post at https://huggingface.co/blog/llama31-on-vertex-ai
In this post, we showcase how to deploy https://huggingface.co/meta-llama/Meta-Llama-3.1-405B-Instruct-FP8 on an A3 instance with 8 x H100 GPUs on Vertex AI
Thanks to the Hugging Face DLCs for TGI and Google Cloud Vertex AI, deploying a high-performance text generation container for serving Large Language Models (LLMs) has never been easier. And weβre not going to stop here β stay tuned as we enable more experiences to build AI with open models on Google Cloud!
Read the full post at https://huggingface.co/blog/llama31-on-vertex-ai
upvoted
an
article
3 months ago
Article
Hugging Face and Google partner for open AI collaboration
β’
4
Reacted to
clem's
post with π₯
3 months ago
Post
4128
Just crossed 200,000 free public AI datasets shared by the community on Hugging Face! Text, image, video, audio, time-series & many more... Thanks everyone!
http://hf.co/datasets
http://hf.co/datasets
liked
a
dataset
3 months ago