FP8 LLMs for vLLM Collection Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 10 items • Updated 2 days ago • 15
view article Article Training and Finetuning Embedding Models with Sentence Transformers v3 25 days ago • 102
view article Article 🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets By dvilasuero • 18 days ago • 63
Qwen1.5 Collection Qwen1.5 is the improved version of Qwen, the large language model series developed by Alibaba Cloud. • 55 items • Updated 16 days ago • 195
view article Article Assisted Generation: a new direction toward low-latency text generation May 11, 2023 • 12