Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
OpenVINO 's Collections
Visual Language Models
Image Generation
Speculative Decoding Draft Models
Speech-to-Text
LLM

Speculative Decoding Draft Models

updated about 20 hours ago

Collection of OpenVINO optimized efficient draft models for speculative decoding

Upvote
9

  • OpenVINO/Llama-3.1-8B-Instruct-FastDraft-150M-int8-ov

    Updated Dec 16, 2024 • 2.89k • 6

  • OpenVINO/Phi-3-mini-FastDraft-50M-int8-ov

    Updated Dec 16, 2024 • 61 • 4

  • OpenVINO/Phi-4-mini-FastDraft-120M-int8-ov

    Updated about 20 hours ago • 1
Upvote
9
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs