FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 10 items • Updated about 7 hours ago • 14
view article Article Training and Finetuning Embedding Models with Sentence Transformers v3 23 days ago • 98
view article Article 🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets By dvilasuero • 16 days ago • 63
Qwen1.5 Collection Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 14 days ago • 194
view article Article Assisted Generation: a new direction toward low-latency text generation May 11, 2023 • 12