danielrosehill/Open-Router-API-Pricing-Analysis huggingface dataset:
Model: Google: Gemini 2.0 Flash Experimental (free)
Vendor: Google
Description: Gemini Flash 2.0 offers a significantly faster time to first token (TTFT) compared to [Gemini Flash 1.5](/google/gemini-flash-1.5), while maintaining quality on par with larger models like [Gemini Pro 1.5](/google/gemini-pro-1.5). It introduces notable enhancements in multimodal understanding, coding capabilities, complex instruction following, and function calling. These advancements come together to deliver more seamless and robust agentic experiences.
Context length: 1048576 tokens
Tokenizer: Gemini
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: max_tokens, response_format, seed, stop, temperature, tool_choice, tools, top_p
Model: Meta: Llama 3.3 70B Instruct (free)
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.3-70B-Instruct
Description: The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.

Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.

[Model Card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/MODEL_CARD.md)
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, stop, temperature, tool_choice, tools, top_k, top_p
Model: Meta: Llama 3.3 70B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.3-70B-Instruct
Description: The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks.

Supported languages: English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai.

[Model Card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_3/MODEL_CARD.md)
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.13
Completion price per 1M tokens (USD): 0.38
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.255
Output/input cost ratio: 2.92
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_logprobs, top_p
Model: Amazon: Nova Lite 1.0
Vendor: Amazon
Description: Amazon Nova Lite 1.0 is a very low-cost multimodal model from Amazon that focused on fast processing of image, video, and text inputs to generate text output. Amazon Nova Lite can handle real-time customer interactions, document analysis, and visual question-answering tasks with high accuracy.

With an input context of 300K tokens, it can analyze multiple images or up to 30 minutes of video in a single input.
Context length: 300000 tokens
Tokenizer: Nova
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 5120.0
Prompt price per 1M tokens (USD): 0.06
Completion price per 1M tokens (USD): 0.24
Image price (USD): 9e-05
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.15
Output/input cost ratio: 4.0
Supported parameters: max_tokens, stop, temperature, tools, top_k, top_p
Model: Amazon: Nova Micro 1.0
Vendor: Amazon
Description: Amazon Nova Micro 1.0 is a text-only model that delivers the lowest latency responses in the Amazon Nova family of models at a very low cost. With a context length of 128K tokens and optimized for speed and cost, Amazon Nova Micro excels at tasks such as text summarization, translation, content classification, interactive chat, and brainstorming. It has  simple mathematical reasoning and coding abilities.
Context length: 128000 tokens
Tokenizer: Nova
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 5120.0
Prompt price per 1M tokens (USD): 0.035
Completion price per 1M tokens (USD): 0.14
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0875
Output/input cost ratio: 4.0
Supported parameters: max_tokens, stop, temperature, tools, top_k, top_p
Model: Amazon: Nova Pro 1.0
Vendor: Amazon
Description: Amazon Nova Pro 1.0 is a capable multimodal model from Amazon focused on providing a combination of accuracy, speed, and cost for a wide range of tasks. As of December 2024, it achieves state-of-the-art performance on key benchmarks including visual question answering (TextVQA) and video understanding (VATEX).

Amazon Nova Pro demonstrates strong capabilities in processing both visual and textual information and at analyzing financial documents.

**NOTE**: Video input is not supported at this time.
Context length: 300000 tokens
Tokenizer: Nova
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 5120.0
Prompt price per 1M tokens (USD): 0.7999999999999999
Completion price per 1M tokens (USD): 3.2
Image price (USD): 0.0012
Request price (USD): 0.0
Median price per 1M tokens (USD): 2.0
Output/input cost ratio: 4.0
Supported parameters: max_tokens, stop, temperature, tools, top_k, top_p
Model: OpenAI: GPT-4o (2024-11-20)
Vendor: OpenAI
Description: The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability. It’s also better at working with uploaded files, providing deeper insights & more thorough responses.

GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities.
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.003613
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: Mistral Large 2411
Vendor: Mistral AI
Description: Mistral Large 2 2411 is an update of [Mistral Large 2](/mistralai/mistral-large) released together with [Pixtral Large 2411](/mistralai/pixtral-large-2411)

It provides a significant upgrade on the previous [Mistral Large 24.07](/mistralai/mistral-large-2407), with notable improvements in long context understanding, a new system prompt, and more accurate function calling.
Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 2.0
Completion price per 1M tokens (USD): 6.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Mistral Large 2407
Vendor: Mistral AI
Description: This is Mistral AI's flagship model, Mistral Large 2 (version mistral-large-2407). It's a proprietary weights-available model and excels at reasoning, code, JSON, chat, and more. Read the launch announcement [here](https://mistral.ai/news/mistral-large-2407/).

It supports dozens of languages including French, German, Spanish, Italian, Portuguese, Arabic, Hindi, Russian, Chinese, Japanese, and Korean, along with 80+ coding languages including Python, Java, C, C++, JavaScript, and Bash. Its long context window allows precise information recall from large documents.

Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 2.0
Completion price per 1M tokens (USD): 6.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Mistral: Pixtral Large 2411
Vendor: Mistral AI
Description: Pixtral Large is a 124B parameter, open-weight, multimodal model built on top of [Mistral Large 2](/mistralai/mistral-large-2411). The model is able to understand documents, charts and natural images.

The model is available under the Mistral Research License (MRL) for research and educational use, and the Mistral Commercial License for experimentation, testing, and production for commercial purposes.


Context length: 131072 tokens
Tokenizer: Mistral
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Prompt price per 1M tokens (USD): 2.0
Completion price per 1M tokens (USD): 6.0
Image price (USD): 0.002888
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Qwen2.5 Coder 32B Instruct (free)
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-Coder-32B-Instruct
Description: Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:

- Significantly improvements in **code generation**, **code reasoning** and **code fixing**. 
- A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.

To read more about its evaluation results, check out [Qwen 2.5 Coder's blog](https://qwenlm.github.io/blog/qwen2.5-coder-family/).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: Qwen2.5 Coder 32B Instruct
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-Coder-32B-Instruct
Description: Qwen2.5-Coder is the latest series of Code-Specific Qwen large language models (formerly known as CodeQwen). Qwen2.5-Coder brings the following improvements upon CodeQwen1.5:

- Significantly improvements in **code generation**, **code reasoning** and **code fixing**. 
- A more comprehensive foundation for real-world applications such as **Code Agents**. Not only enhancing coding capabilities but also maintaining its strengths in mathematics and general competencies.

To read more about its evaluation results, check out [Qwen 2.5 Coder's blog](https://qwenlm.github.io/blog/qwen2.5-coder-family/).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 32768.0
Prompt price per 1M tokens (USD): 0.04
Completion price per 1M tokens (USD): 0.16
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.1
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_k, top_p
Model: SorcererLM 8x22B
Vendor: Raifle
Hugging Face ID: rAIfle/SorcererLM-8x22b-bf16
Description: SorcererLM is an advanced RP and storytelling model, built as a Low-rank 16-bit LoRA fine-tuned on [WizardLM-2 8x22B](/microsoft/wizardlm-2-8x22b).

- Advanced reasoning and emotional intelligence for engaging and immersive interactions
- Vivid writing capabilities enriched with spatial and contextual awareness
- Enhanced narrative depth, promoting creative and dynamic storytelling
Context length: 16000 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 4.5
Completion price per 1M tokens (USD): 4.5
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.5
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: TheDrummer: UnslopNemo 12B
Vendor: TheDrummer
Hugging Face ID: TheDrummer/UnslopNemo-12B-v4.1
Description: UnslopNemo v4.1 is the latest addition from the creator of Rocinante, designed for adventure writing and role-play scenarios.
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.3999999999999999
Completion price per 1M tokens (USD): 0.3999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.3999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Anthropic: Claude 3.5 Haiku
Vendor: Anthropic
Description: Claude 3.5 Haiku features offers enhanced capabilities in speed, coding accuracy, and tool use. Engineered to excel in real-time applications, it delivers quick response times that are essential for dynamic tasks such as chat interactions and immediate coding suggestions.

This makes it highly suitable for environments that demand both speed and precision, such as software development, customer service bots, and data management systems.

This model is currently pointing to [Claude 3.5 Haiku (2024-10-22)](/anthropic/claude-3-5-haiku-20241022).
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 0.7999999999999999
Completion price per 1M tokens (USD): 4.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 2.4
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Anthropic: Claude 3.5 Haiku (2024-10-22)
Vendor: Anthropic
Description: Claude 3.5 Haiku features enhancements across all skill sets including coding, tool use, and reasoning. As the fastest model in the Anthropic lineup, it offers rapid response times suitable for applications that require high interactivity and low latency, such as user-facing chatbots and on-the-fly code completions. It also excels in specialized tasks like data extraction and real-time content moderation, making it a versatile tool for a broad range of industries.

It does not support image inputs.

See the launch announcement and benchmark results [here](https://www.anthropic.com/news/3-5-models-and-computer-use)
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 0.7999999999999999
Completion price per 1M tokens (USD): 4.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 2.4
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Magnum v4 72B
Vendor: Anthracite
Hugging Face ID: anthracite-org/magnum-v4-72b
Description: This is a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet(https://openrouter.ai/anthropic/claude-3.5-sonnet) and Opus(https://openrouter.ai/anthropic/claude-3-opus).

The model is fine-tuned on top of [Qwen2.5 72B](https://openrouter.ai/qwen/qwen-2.5-72b-instruct).
Context length: 16384 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 2048.0
Prompt price per 1M tokens (USD): 3.0
Completion price per 1M tokens (USD): 5.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 1.67
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_a, top_k, top_logprobs, top_p
Model: Anthropic: Claude 3.5 Sonnet
Vendor: Anthropic
Description: New Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at:

- Coding: Scores ~49% on SWE-Bench Verified, higher than the last best score, and without any fancy prompt scaffolding
- Data science: Augments human data science expertise; navigates unstructured data while using multiple tools for insights
- Visual processing: excelling at interpreting charts, graphs, and images, accurately transcribing text to derive insights beyond just the text alone
- Agentic tasks: exceptional tool use, making it great at agentic tasks (i.e. complex, multi-step problem solving tasks that require engaging with other systems)

#multimodal
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 3.0
Completion price per 1M tokens (USD): 15.0
Image price (USD): 0.0048
Request price (USD): 0.0
Median price per 1M tokens (USD): 9.0
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral: Ministral 3B
Vendor: Mistral AI
Description: Ministral 3B is a 3B parameter model optimized for on-device and edge computing. It excels in knowledge, commonsense reasoning, and function-calling, outperforming larger models like Mistral 7B on most benchmarks. Supporting up to 128k context length, it’s ideal for orchestrating agentic workflows and specialist tasks with efficient inference.
Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.04
Completion price per 1M tokens (USD): 0.04
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.04
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Mistral: Ministral 8B
Vendor: Mistral AI
Description: Ministral 8B is an 8B parameter model featuring a unique interleaved sliding-window attention pattern for faster, memory-efficient inference. Designed for edge use cases, it supports up to 128k context length and excels in knowledge and reasoning tasks. It outperforms peers in the sub-10B category, making it perfect for low-latency, privacy-first applications.
Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0999999999999999
Completion price per 1M tokens (USD): 0.0999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Qwen: Qwen2.5 7B Instruct
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-7B-Instruct
Description: Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2:

- Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains.

- Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots.

- Long-context Support up to 128K tokens and can generate up to 8K tokens.

- Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.

Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.04
Completion price per 1M tokens (USD): 0.0999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0699999999999999
Output/input cost ratio: 2.5
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: NVIDIA: Llama 3.1 Nemotron 70B Instruct
Vendor: NVIDIA
Hugging Face ID: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
Description: NVIDIA's Llama 3.1 Nemotron 70B is a language model designed for generating precise and useful responses. Leveraging [Llama 3.1 70B](/models/meta-llama/llama-3.1-70b-instruct) architecture and Reinforcement Learning from Human Feedback (RLHF), it excels in automatic alignment benchmarks. This model is tailored for applications requiring high accuracy in helpfulness and response generation, suitable for diverse user queries across multiple domains.

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.6
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.6
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Inflection: Inflection 3 Productivity
Vendor: Inflection AI
Description: Inflection 3 Productivity is optimized for following instructions. It is better for tasks requiring JSON output or precise adherence to provided guidelines. It has access to recent news.

For emotional intelligence similar to Pi, see [Inflect 3 Pi](/inflection/inflection-3-pi)

See [Inflection's announcement](https://inflection.ai/blog/enterprise) for more details.
Context length: 8000 tokens
Tokenizer: Other
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 1024.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: max_tokens, stop, temperature, top_p
Model: Inflection: Inflection 3 Pi
Vendor: Inflection AI
Description: Inflection 3 Pi powers Inflection's [Pi](https://pi.ai) chatbot, including backstory, emotional intelligence, productivity, and safety. It has access to recent news, and excels in scenarios like customer support and roleplay.

Pi has been trained to mirror your tone and style, if you use more emojis, so will Pi! Try experimenting with various prompts and conversation styles.
Context length: 8000 tokens
Tokenizer: Other
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 1024.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: max_tokens, stop, temperature, top_p
Model: TheDrummer: Rocinante 12B
Vendor: TheDrummer
Hugging Face ID: TheDrummer/Rocinante-12B-v1.1
Description: Rocinante 12B is designed for engaging storytelling and rich prose.

Early testers have reported:
- Expanded vocabulary with unique and expressive word choices
- Enhanced creativity for vivid narratives
- Adventure-filled and captivating stories
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.1699999999999999
Completion price per 1M tokens (USD): 0.43
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.3
Output/input cost ratio: 2.53
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Meta: Llama 3.2 1B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.2-1B-Instruct
Description: Llama 3.2 1B is a 1-billion-parameter language model focused on efficiently performing natural language tasks, such as summarization, dialogue, and multilingual text analysis. Its smaller size allows it to operate efficiently in low-resource environments while maintaining strong task performance.

Supporting eight core languages and fine-tunable for more, Llama 1.3B is ideal for businesses or developers seeking lightweight yet powerful AI solutions that can operate in diverse multilingual settings without the high computational demand of larger models.

Click here for the [original model card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/MODEL_CARD.md).

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.005
Completion price per 1M tokens (USD): 0.01
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0075
Output/input cost ratio: 2.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p
Model: Meta: Llama 3.2 3B Instruct (free)
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.2-3B-Instruct
Description: Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it supports eight languages, including English, Spanish, and Hindi, and is adaptable for additional languages.

Trained on 9 trillion tokens, the Llama 3.2 3B model excels in instruction-following, complex reasoning, and tool use. Its balanced performance makes it ideal for applications needing accuracy and efficiency in text generation across multilingual settings.

Click here for the [original model card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/MODEL_CARD.md).

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, stop, temperature, top_k, top_p
Model: Meta: Llama 3.2 3B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.2-3B-Instruct
Description: Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it supports eight languages, including English, Spanish, and Hindi, and is adaptable for additional languages.

Trained on 9 trillion tokens, the Llama 3.2 3B model excels in instruction-following, complex reasoning, and tool use. Its balanced performance makes it ideal for applications needing accuracy and efficiency in text generation across multilingual settings.

Click here for the [original model card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/MODEL_CARD.md).

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.02
Completion price per 1M tokens (USD): 0.02
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.02
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Meta: Llama 3.2 11B Vision Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.2-11B-Vision-Instruct
Description: Llama 3.2 11B Vision is a multimodal model with 11 billion parameters, designed to handle tasks combining visual and textual data. It excels in tasks such as image captioning and visual question answering, bridging the gap between language generation and visual reasoning. Pre-trained on a massive dataset of image-text pairs, it performs well in complex, high-accuracy image analysis.

Its ability to integrate visual understanding with language processing makes it an ideal solution for industries requiring comprehensive visual-linguistic AI applications, such as content creation, AI-driven customer service, and research.

Click here for the [original model card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/MODEL_CARD_VISION.md).

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.049
Completion price per 1M tokens (USD): 0.049
Image price (USD): 7.948e-05
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.049
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p
Model: Meta: Llama 3.2 90B Vision Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Llama-3.2-90B-Vision-Instruct
Description: The Llama 90B Vision model is a top-tier, 90-billion-parameter multimodal model designed for the most challenging visual reasoning and language tasks. It offers unparalleled accuracy in image captioning, visual question answering, and advanced image-text comprehension. Pre-trained on vast multimodal datasets and fine-tuned with human feedback, the Llama 90B Vision is engineered to handle the most demanding image-based AI tasks.

This model is perfect for industries requiring cutting-edge multimodal AI capabilities, particularly those dealing with complex, real-time visual and textual analysis.

Click here for the [original model card](https://github.com/meta-llama/llama-models/blob/main/models/llama3_2/MODEL_CARD_VISION.md).

Usage of this model is subject to [Meta's Acceptable Use Policy](https://www.llama.com/llama3/use-policy/).
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.35
Completion price per 1M tokens (USD): 0.3999999999999999
Image price (USD): 0.0005058
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.375
Output/input cost ratio: 1.14
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p
Model: Qwen2.5 72B Instruct (free)
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-72B-Instruct
Description: Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2:

- Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains.

- Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots.

- Long-context Support up to 128K tokens and can generate up to 8K tokens.

- Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.

Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: Qwen2.5 72B Instruct
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-72B-Instruct
Description: Qwen2.5 72B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2:

- Significantly more knowledge and has greatly improved capabilities in coding and mathematics, thanks to our specialized expert models in these domains.

- Significant improvements in instruction following, generating long texts (over 8K tokens), understanding structured data (e.g, tables), and generating structured outputs especially JSON. More resilient to the diversity of system prompts, enhancing role-play implementation and condition-setting for chatbots.

- Long-context Support up to 128K tokens and can generate up to 8K tokens.

- Multilingual support for over 29 languages, including Chinese, English, French, Spanish, Portuguese, German, Italian, Russian, Japanese, Korean, Vietnamese, Thai, Arabic, and more.

Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 32768.0
Prompt price per 1M tokens (USD): 0.07
Completion price per 1M tokens (USD): 0.26
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.165
Output/input cost ratio: 3.71
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: NeverSleep: Lumimaid v0.2 8B
Vendor: Neversleep
Hugging Face ID: NeverSleep/Lumimaid-v0.2-8B
Description: Lumimaid v0.2 8B is a finetune of [Llama 3.1 8B](/models/meta-llama/llama-3.1-8b-instruct) with a "HUGE step up dataset wise" compared to Lumimaid v0.1. Sloppy chats output were purged.

Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.09
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.345
Output/input cost ratio: 6.67
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_a, top_k, top_logprobs, top_p
Model: Mistral: Pixtral 12B
Vendor: Mistral AI
Hugging Face ID: mistralai/Pixtral-12B-2409
Description: The first multi-modal, text+image-to-text model from Mistral AI. Its weights were launched via torrent: https://x.com/mistralai/status/1833758285167722836.
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Prompt price per 1M tokens (USD): 0.0999999999999999
Completion price per 1M tokens (USD): 0.0999999999999999
Image price (USD): 0.0001445
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Cohere: Command R+ (08-2024)
Vendor: Cohere
Description: command-r-plus-08-2024 is an update of the [Command R+](/models/cohere/command-r-plus) with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint the same.

Read the launch post [here](https://docs.cohere.com/changelog/command-gets-refreshed).

Use of this model is subject to Cohere's [Usage Policy](https://docs.cohere.com/docs/usage-policy) and [SaaS Agreement](https://cohere.com/saas-agreement).
Context length: 128000 tokens
Tokenizer: Cohere
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4000.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Cohere: Command R (08-2024)
Vendor: Cohere
Description: command-r-08-2024 is an update of the [Command R](/models/cohere/command-r) with improved performance for multilingual retrieval-augmented generation (RAG) and tool use. More broadly, it is better at math, code and reasoning and is competitive with the previous version of the larger Command R+ model.

Read the launch post [here](https://docs.cohere.com/changelog/command-gets-refreshed).

Use of this model is subject to Cohere's [Usage Policy](https://docs.cohere.com/docs/usage-policy) and [SaaS Agreement](https://cohere.com/saas-agreement).
Context length: 128000 tokens
Tokenizer: Cohere
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4000.0
Prompt price per 1M tokens (USD): 0.15
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.375
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Qwen: Qwen2.5-VL 7B Instruct
Vendor: Qwen
Hugging Face ID: Qwen/Qwen2.5-VL-7B-Instruct
Description: Qwen2.5 VL 7B is a multimodal LLM from the Qwen Team with the following key enhancements:

- SoTA understanding of images of various resolution & ratio: Qwen2.5-VL achieves state-of-the-art performance on visual understanding benchmarks, including MathVista, DocVQA, RealWorldQA, MTVQA, etc.

- Understanding videos of 20min+: Qwen2.5-VL can understand videos over 20 minutes for high-quality video-based question answering, dialog, content creation, etc.

- Agent that can operate your mobiles, robots, etc.: with the abilities of complex reasoning and decision making, Qwen2.5-VL can be integrated with devices like mobile phones, robots, etc., for automatic operation based on visual environment and text instructions.

- Multilingual Support: to serve global users, besides English and Chinese, Qwen2.5-VL now supports the understanding of texts in different languages inside images, including most European languages, Japanese, Korean, Arabic, Vietnamese, etc.

For more details, see this [blog post](https://qwenlm.github.io/blog/qwen2-vl/) and [GitHub repo](https://github.com/QwenLM/Qwen2-VL).

Usage of this model is subject to [Tongyi Qianwen LICENSE AGREEMENT](https://huggingface.co/Qwen/Qwen1.5-110B-Chat/blob/main/LICENSE).
Context length: 32768 tokens
Tokenizer: Qwen
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Prompt price per 1M tokens (USD): 0.1999999999999999
Completion price per 1M tokens (USD): 0.1999999999999999
Image price (USD): 0.0001445
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.1999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: Sao10K: Llama 3.1 Euryale 70B v2.2
Vendor: Sao10k
Hugging Face ID: Sao10K/L3.1-70B-Euryale-v2.2
Description: Euryale L3.1 70B v2.2 is a model focused on creative roleplay from [Sao10k](https://ko-fi.com/sao10k). It is the successor of [Euryale L3 70B v2.1](/models/sao10k/l3-euryale-70b).
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.65
Completion price per 1M tokens (USD): 0.75
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.7
Output/input cost ratio: 1.15
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Microsoft: Phi-3.5 Mini 128K Instruct
Vendor: Microsoft
Hugging Face ID: microsoft/Phi-3.5-mini-instruct
Description: Phi-3.5 models are lightweight, state-of-the-art open models. These models were trained with Phi-3 datasets that include both synthetic data and the filtered, publicly available websites data, with a focus on high quality and reasoning-dense properties. Phi-3.5 Mini uses 3.8B parameters, and is a dense decoder-only transformer model using the same tokenizer as [Phi-3 Mini](/models/microsoft/phi-3-mini-128k-instruct).

The models underwent a rigorous enhancement process, incorporating both supervised fine-tuning, proximal policy optimization, and direct preference optimization to ensure precise instruction adherence and robust safety measures. When assessed against benchmarks that test common sense, language understanding, math, code, long context and logical reasoning, Phi-3.5 models showcased robust and state-of-the-art performance among models with less than 13 billion parameters.
Context length: 128000 tokens
Tokenizer: Other
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0999999999999999
Completion price per 1M tokens (USD): 0.0999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0999999999999999
Output/input cost ratio: 1.0
Supported parameters: max_tokens, temperature, tool_choice, tools, top_p
Model: Nous: Hermes 3 70B Instruct
Vendor: Nous Research
Hugging Face ID: NousResearch/Hermes-3-Llama-3.1-70B
Description: Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board.

Hermes 3 70B is a competitive, if not superior finetune of the [Llama-3.1 70B foundation model](/models/meta-llama/llama-3.1-70b-instruct), focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user.

The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills.
Context length: 65536 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.3
Completion price per 1M tokens (USD): 0.3
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.3
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Nous: Hermes 3 405B Instruct (free)
Vendor: Nous Research
Hugging Face ID: NousResearch/Hermes-3-Llama-3.1-405B
Description: Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board.

Hermes 3 405B is a frontier-level, full-parameter finetune of the Llama-3.1 405B foundation model, focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user.

The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills.

Hermes 3 is competitive, if not superior, to Llama-3.1 Instruct models at general capabilities, with varying strengths and weaknesses attributable between the two.
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, stop, temperature, top_k, top_p