Shawn TIAN

U2hhd24's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic 4 months ago

How to serve this fp8 model in vllm?

4

#1 opened 4 months ago by

U2hhd24

How to serve this fp8 model in vllm?

4

#1 opened 4 months ago by

U2hhd24