danielrosehill/Open-Router-API-Pricing-Analysis huggingface dataset:
Model: Nous: Hermes 3 405B Instruct
Vendor: Nous Research
Hugging Face ID: NousResearch/Hermes-3-Llama-3.1-405B
Description: Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the board.

Hermes 3 405B is a frontier-level, full-parameter finetune of the Llama-3.1 405B foundation model, focused on aligning LLMs to the user, with powerful steering capabilities and control given to the end user.

The Hermes 3 series builds and expands on the Hermes 2 set of capabilities, including more powerful and reliable function calling and structured output capabilities, generalist assistant capabilities, and improved code generation skills.

Hermes 3 is competitive, if not superior, to Llama-3.1 Instruct models at general capabilities, with varying strengths and weaknesses attributable between the two.
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 1.0
Completion price per 1M tokens (USD): 1.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.0
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p
Model: OpenAI: ChatGPT-4o
Vendor: OpenAI
Description: OpenAI ChatGPT 4o is continually updated by OpenAI to point to the current version of GPT-4o used by ChatGPT. It therefore differs slightly from the API version of [GPT-4o](/models/openai/gpt-4o) in that it has additional RLHF. It is intended for research and evaluation.

OpenAI notes that this model is not suited for production use-cases as it may be removed or redirected to another model in the future.
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 5.0
Completion price per 1M tokens (USD): 15.0
Image price (USD): 0.007225
Request price (USD): 0.0
Median price per 1M tokens (USD): 10.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, top_logprobs, top_p
Model: Sao10K: Llama 3 8B Lunaris
Vendor: Sao10k
Hugging Face ID: Sao10K/L3-8B-Lunaris-v1
Description: Lunaris 8B is a versatile generalist and roleplaying model based on Llama 3. It's a strategic merge of multiple models, designed to balance creativity with improved logic and general knowledge.

Created by [Sao10k](https://huggingface.co/Sao10k), this model aims to offer an improved experience over Stheno v3.2, with enhanced creativity and logical reasoning.

For best results, use with Llama 3 Instruct context template, temperature 1.4, and min_p 0.1.
Context length: 8192 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.04
Completion price per 1M tokens (USD): 0.0499999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.045
Output/input cost ratio: 1.25
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_k, top_p
Model: OpenAI: GPT-4o (2024-08-06)
Vendor: OpenAI
Description: The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.com/index/introducing-structured-outputs-in-the-api/).

GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities.

For benchmarking against other models, it was briefly called ["im-also-a-good-gpt2-chatbot"](https://twitter.com/LiamFedus/status/1790064963966370209)
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.003613
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: Meta: Llama 3.1 405B (base)
Vendor: Meta
Hugging Face ID: meta-llama/llama-3.1-405B
Description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This is the base 405B pre-trained version.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 32768.0
Prompt price per 1M tokens (USD): 4.0
Completion price per 1M tokens (USD): 4.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: Meta: Llama 3.1 8B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-3.1-8B-Instruct
Description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.02
Completion price per 1M tokens (USD): 0.03
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.025
Output/input cost ratio: 1.5
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_logprobs, top_p
Model: Meta: Llama 3.1 405B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-3.1-405B-Instruct
Description: The highly anticipated 400B class of Llama3 is here! Clocking in at 128k context with impressive eval scores, the Meta AI team continues to push the frontier of open-source LLMs.

Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 405B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models including GPT-4o and Claude 3.5 Sonnet in evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.7999999999999999
Completion price per 1M tokens (USD): 0.7999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.7999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Meta: Llama 3.1 70B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-3.1-70B-Instruct
Description: Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3-1/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 131072 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.3999999999999999
Completion price per 1M tokens (USD): 0.3999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.3999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral: Mistral Nemo (free)
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-Nemo-Instruct-2407
Description: A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA.

The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi.

It supports function calling and is released under the Apache 2.0 license.
Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 128000.0
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, seed, stop, temperature, top_k, top_p
Model: Mistral: Mistral Nemo
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-Nemo-Instruct-2407
Description: A 12B parameter model with a 128k token context length built by Mistral in collaboration with NVIDIA.

The model is multilingual, supporting English, French, German, Spanish, Italian, Portuguese, Chinese, Japanese, Korean, Arabic, and Hindi.

It supports function calling and is released under the Apache 2.0 license.
Context length: 131072 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.02
Completion price per 1M tokens (USD): 0.04
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.03
Output/input cost ratio: 2.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: OpenAI: GPT-4o-mini
Vendor: OpenAI
Description: GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs.

As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than [GPT-3.5 Turbo](/models/openai/gpt-3.5-turbo). It maintains SOTA intelligence, while being significantly more cost-effective.

GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences [common leaderboards](https://arena.lmsys.org/).

Check out the [launch announcement](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) to learn more.

#multimodal
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.15
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.000217
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.375
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: OpenAI: GPT-4o-mini (2024-07-18)
Vendor: OpenAI
Description: GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs.

As their most advanced small model, it is many multiples more affordable than other recent frontier models, and more than 60% cheaper than [GPT-3.5 Turbo](/models/openai/gpt-3.5-turbo). It maintains SOTA intelligence, while being significantly more cost-effective.

GPT-4o mini achieves an 82% score on MMLU and presently ranks higher than GPT-4 on chat preferences [common leaderboards](https://arena.lmsys.org/).

Check out the [launch announcement](https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/) to learn more.

#multimodal
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.15
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.007225
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.375
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: Google: Gemma 2 27B
Vendor: Google
Hugging Face ID: google/gemma-2-27b-it
Description: Gemma 2 27B by Google is an open model built from the same research and technology used to create the [Gemini models](/models?q=gemini).

Gemma models are well-suited for a variety of text generation tasks, including question answering, summarization, and reasoning.

See the [launch announcement](https://blog.google/technology/developers/google-gemma-2/) for more details. Usage of Gemma is subject to Google's [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
Context length: 8192 tokens
Tokenizer: Gemini
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.65
Completion price per 1M tokens (USD): 0.65
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.65
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, stop, structured_outputs, temperature, top_p
Model: Google: Gemma 2 9B
Vendor: Google
Hugging Face ID: google/gemma-2-9b-it
Description: Gemma 2 9B by Google is an advanced, open-source language model that sets a new standard for efficiency and performance in its size class.

Designed for a wide variety of tasks, it empowers developers and researchers to build innovative applications, while maintaining accessibility, safety, and cost-effectiveness.

See the [launch announcement](https://blog.google/technology/developers/google-gemma-2/) for more details. Usage of Gemma is subject to Google's [Gemma Terms of Use](https://ai.google.dev/gemma/terms).
Context length: 8192 tokens
Tokenizer: Gemini
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.03
Completion price per 1M tokens (USD): 0.09
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.06
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, temperature, top_k, top_p
Model: Anthropic: Claude 3.5 Sonnet (2024-06-20)
Vendor: Anthropic
Description: Claude 3.5 Sonnet delivers better-than-Opus capabilities, faster-than-Sonnet speeds, at the same Sonnet prices. Sonnet is particularly good at:

- Coding: Autonomously writes, edits, and runs code with reasoning and troubleshooting
- Data science: Augments human data science expertise; navigates unstructured data while using multiple tools for insights
- Visual processing: excelling at interpreting charts, graphs, and images, accurately transcribing text to derive insights beyond just the text alone
- Agentic tasks: exceptional tool use, making it great at agentic tasks (i.e. complex, multi-step problem solving tasks that require engaging with other systems)

For the latest version (2024-10-23), check out [Claude 3.5 Sonnet](/anthropic/claude-3.5-sonnet).

#multimodal
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 3.0
Completion price per 1M tokens (USD): 15.0
Image price (USD): 0.0048
Request price (USD): 0.0
Median price per 1M tokens (USD): 9.0
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Sao10k: Llama 3 Euryale 70B v2.1
Vendor: Sao10k
Hugging Face ID: Sao10K/L3-70B-Euryale-v2.1
Description: Euryale 70B v2.1 is a model focused on creative roleplay from [Sao10k](https://ko-fi.com/sao10k).

- Better prompt adherence.
- Better anatomy / spatial awareness.
- Adapts much better to unique and custom formatting / reply formats.
- Very creative, lots of unique swipes.
- Is not restrictive during roleplays.
Context length: 8192 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 8192.0
Prompt price per 1M tokens (USD): 1.48
Completion price per 1M tokens (USD): 1.48
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.48
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: NousResearch: Hermes 2 Pro - Llama-3 8B
Vendor: Nous Research
Hugging Face ID: NousResearch/Hermes-2-Pro-Llama-3-8B
Description: Hermes 2 Pro is an upgraded, retrained version of Nous Hermes 2, consisting of an updated and cleaned version of the OpenHermes 2.5 Dataset, as well as a newly introduced Function Calling and JSON Mode dataset developed in-house.
Context length: 32768 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0249999999999999
Completion price per 1M tokens (USD): 0.08
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0525
Output/input cost ratio: 3.2
Supported parameters: frequency_penalty, max_tokens, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_k, top_p
Model: Mistral: Mistral 7B Instruct (free)
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-7B-Instruct-v0.3
Description: A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.

*Mistral 7B Instruct has multiple version variants, and this is intended to be the latest version.*
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.0
Completion price per 1M tokens (USD): 0.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral: Mistral 7B Instruct
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-7B-Instruct-v0.3
Description: A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.

*Mistral 7B Instruct has multiple version variants, and this is intended to be the latest version.*
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.028
Completion price per 1M tokens (USD): 0.054
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.041
Output/input cost ratio: 1.93
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral: Mistral 7B Instruct v0.3
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-7B-Instruct-v0.3
Description: A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.

An improved version of [Mistral 7B Instruct v0.2](/models/mistralai/mistral-7b-instruct-v0.2), with the following changes:

- Extended vocabulary to 32768
- Supports v3 Tokenizer
- Supports function calling

NOTE: Support for function calling depends on the provider.
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.028
Completion price per 1M tokens (USD): 0.054
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.041
Output/input cost ratio: 1.93
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Microsoft: Phi-3 Mini 128K Instruct
Vendor: Microsoft
Hugging Face ID: microsoft/Phi-3-mini-128k-instruct
Description: Phi-3 Mini is a powerful 3.8B parameter model designed for advanced language understanding, reasoning, and instruction following. Optimized through supervised fine-tuning and preference adjustments, it excels in tasks involving common sense, mathematics, logical reasoning, and code processing.

At time of release, Phi-3 Medium demonstrated state-of-the-art performance among lightweight models. This model is static, trained on an offline dataset with an October 2023 cutoff date.
Context length: 128000 tokens
Tokenizer: Other
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.0999999999999999
Completion price per 1M tokens (USD): 0.0999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0999999999999999
Output/input cost ratio: 1.0
Supported parameters: max_tokens, temperature, tool_choice, tools, top_p
Model: Microsoft: Phi-3 Medium 128K Instruct
Vendor: Microsoft
Hugging Face ID: microsoft/Phi-3-medium-128k-instruct
Description: Phi-3 128K Medium is a powerful 14-billion parameter model designed for advanced language understanding, reasoning, and instruction following. Optimized through supervised fine-tuning and preference adjustments, it excels in tasks involving common sense, mathematics, logical reasoning, and code processing.

At time of release, Phi-3 Medium demonstrated state-of-the-art performance among lightweight models. In the MMLU-Pro eval, the model even comes close to a Llama3 70B level of performance.

For 4k context length, try [Phi-3 Medium 4K](/models/microsoft/phi-3-medium-4k-instruct).
Context length: 128000 tokens
Tokenizer: Other
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 1.0
Completion price per 1M tokens (USD): 1.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.0
Output/input cost ratio: 1.0
Supported parameters: max_tokens, temperature, tool_choice, tools, top_p
Model: Meta: LlamaGuard 2 8B
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-Guard-2-8B
Description: This safeguard model has 8B parameters and is based on the Llama 3 family. Just like is predecessor, [LlamaGuard 1](https://huggingface.co/meta-llama/LlamaGuard-7b), it can do both prompt and response classification.

LlamaGuard 2 acts as a normal LLM would, generating text that indicates whether the given input/output is safe/unsafe. If deemed unsafe, it will also share the content categories violated.

For best results, please use raw prompt input or the `/completions` endpoint, instead of the chat API.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 8192 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.1999999999999999
Completion price per 1M tokens (USD): 0.1999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.1999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, stop, temperature, top_k, top_p
Model: OpenAI: GPT-4o (2024-05-13)
Vendor: OpenAI
Description: GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities.

For benchmarking against other models, it was briefly called ["im-also-a-good-gpt2-chatbot"](https://twitter.com/LiamFedus/status/1790064963966370209)

#multimodal
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 5.0
Completion price per 1M tokens (USD): 15.0
Image price (USD): 0.007225
Request price (USD): 0.0
Median price per 1M tokens (USD): 10.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: OpenAI: GPT-4o
Vendor: OpenAI
Description: GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities.

For benchmarking against other models, it was briefly called ["im-also-a-good-gpt2-chatbot"](https://twitter.com/LiamFedus/status/1790064963966370209)

#multimodal
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 2.5
Completion price per 1M tokens (USD): 10.0
Image price (USD): 0.003613
Request price (USD): 0.0
Median price per 1M tokens (USD): 6.25
Output/input cost ratio: 4.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: OpenAI: GPT-4o (extended)
Vendor: OpenAI
Description: GPT-4o ("o" for "omni") is OpenAI's latest AI model, supporting both text and image inputs with text outputs. It maintains the intelligence level of [GPT-4 Turbo](/models/openai/gpt-4-turbo) while being twice as fast and 50% more cost-effective. GPT-4o also offers improved performance in processing non-English languages and enhanced visual capabilities.

For benchmarking against other models, it was briefly called ["im-also-a-good-gpt2-chatbot"](https://twitter.com/LiamFedus/status/1790064963966370209)

#multimodal
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image, file
Output modalities: text
Max completion tokens (top provider): 64000.0
Prompt price per 1M tokens (USD): 6.0
Completion price per 1M tokens (USD): 18.0
Image price (USD): 0.007225
Request price (USD): 0.0
Median price per 1M tokens (USD): 12.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p, web_search_options
Model: Meta: Llama 3 70B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-3-70B-Instruct
Description: Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 70B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 8192 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.3
Completion price per 1M tokens (USD): 0.3999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.35
Output/input cost ratio: 1.33
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_k, top_p
Model: Meta: Llama 3 8B Instruct
Vendor: Meta
Hugging Face ID: meta-llama/Meta-Llama-3-8B-Instruct
Description: Meta's latest class of model (Llama 3) launched with a variety of sizes & flavors. This 8B instruct-tuned version was optimized for high quality dialogue usecases.

It has demonstrated strong performance compared to leading closed-source models in human evaluations.

To read more about the model release, [click here](https://ai.meta.com/blog/meta-llama-3/). Usage of this model is subject to [Meta's Acceptable Use Policy](https://llama.meta.com/llama3/use-policy/).
Context length: 8192 tokens
Tokenizer: Llama3
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.03
Completion price per 1M tokens (USD): 0.06
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.045
Output/input cost ratio: 2.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral: Mixtral 8x22B Instruct
Vendor: Mistral AI
Hugging Face ID: mistralai/Mixtral-8x22B-Instruct-v0.1
Description: Mistral's official instruct fine-tuned version of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b). It uses 39B active parameters out of 141B, offering unparalleled cost efficiency for its size. Its strengths include:
- strong math, coding, and reasoning
- large context length (64k)
- fluency in English, French, Italian, German, and Spanish

See benchmarks on the launch announcement [here](https://mistral.ai/news/mixtral-8x22b/).
#moe
Context length: 65536 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 2.0
Completion price per 1M tokens (USD): 6.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: WizardLM-2 8x22B
Vendor: Microsoft
Hugging Face ID: microsoft/WizardLM-2-8x22B
Description: WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models.

It is an instruct finetune of [Mixtral 8x22B](/models/mistralai/mixtral-8x22b).

To read more about the model release, [click here](https://wizardlm.github.io/WizardLM2/).

#moe
Context length: 65536 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.48
Completion price per 1M tokens (USD): 0.48
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.48
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, top_k, top_p
Model: OpenAI: GPT-4 Turbo
Vendor: OpenAI
Description: The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling.

Training data: up to December 2023.
Context length: 128000 tokens
Tokenizer: GPT
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 10.0
Completion price per 1M tokens (USD): 30.0
Image price (USD): 0.01445
Request price (USD): 0.0
Median price per 1M tokens (USD): 20.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p
Model: Anthropic: Claude 3 Haiku
Vendor: Anthropic
Description: Claude 3 Haiku is Anthropic's fastest and most compact model for
near-instant responsiveness. Quick and accurate targeted performance.

See the launch announcement and benchmark results [here](https://www.anthropic.com/news/claude-3-haiku)

#multimodal
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 0.25
Completion price per 1M tokens (USD): 1.25
Image price (USD): 0.0004
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.75
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Anthropic: Claude 3 Opus
Vendor: Anthropic
Description: Claude 3 Opus is Anthropic's most powerful model for highly complex tasks. It boasts top-level performance, intelligence, fluency, and understanding.

See the launch announcement and benchmark results [here](https://www.anthropic.com/news/claude-3-family)

#multimodal
Context length: 200000 tokens
Tokenizer: Claude
Modality: text+image->text
Input modalities: text, image
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 15.0
Completion price per 1M tokens (USD): 75.0
Image price (USD): 0.024
Request price (USD): 0.0
Median price per 1M tokens (USD): 45.0
Output/input cost ratio: 5.0
Supported parameters: max_tokens, stop, temperature, tool_choice, tools, top_k, top_p
Model: Mistral Large
Vendor: Mistral AI
Description: This is Mistral AI's flagship model, Mistral Large 2 (version `mistral-large-2407`). It's a proprietary weights-available model and excels at reasoning, code, JSON, chat, and more. Read the launch announcement [here](https://mistral.ai/news/mistral-large-2407/).

It supports dozens of languages including French, German, Spanish, Italian, Portuguese, Arabic, Hindi, Russian, Chinese, Japanese, and Korean, along with 80+ coding languages including Python, Java, C, C++, JavaScript, and Bash. Its long context window allows precise information recall from large documents.
Context length: 128000 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 2.0
Completion price per 1M tokens (USD): 6.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: OpenAI: GPT-4 Turbo Preview
Vendor: OpenAI
Description: The preview GPT-4 model with improved instruction following, JSON mode, reproducible outputs, parallel function calling, and more. Training data: up to Dec 2023.

**Note:** heavily rate limited by OpenAI while in preview.
Context length: 128000 tokens
Tokenizer: GPT
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 10.0
Completion price per 1M tokens (USD): 30.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 20.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p
Model: OpenAI: GPT-3.5 Turbo (older v0613)
Vendor: OpenAI
Description: GPT-3.5 Turbo is OpenAI's fastest model. It can understand and generate natural language or code, and is optimized for chat and traditional completion tasks.

Training data up to Sep 2021.
Context length: 4095 tokens
Tokenizer: GPT
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 1.0
Completion price per 1M tokens (USD): 2.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.5
Output/input cost ratio: 2.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p
Model: Mistral Tiny
Vendor: Mistral AI
Description: Note: This model is being deprecated. Recommended replacement is the newer [Ministral 8B](/mistral/ministral-8b)

This model is currently powered by Mistral-7B-v0.2, and incorporates a "better" fine-tuning than [Mistral 7B](/models/mistralai/mistral-7b-instruct-v0.1), inspired by community work. It's best used for large batch processing tasks where cost is a significant factor but reasoning capabilities are not crucial.
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.25
Completion price per 1M tokens (USD): 0.25
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.25
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Mistral Small
Vendor: Mistral AI
Description: With 22 billion parameters, Mistral Small v24.09 offers a convenient mid-point between (Mistral NeMo 12B)[/mistralai/mistral-nemo] and (Mistral Large 2)[/mistralai/mistral-large], providing a cost-effective solution that can be deployed across various platforms and environments. It has better reasoning, exhibits more capabilities, can produce and reason about code, and is multiligual, supporting English, French, German, Italian, and Spanish.
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.1999999999999999
Completion price per 1M tokens (USD): 0.6
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.3999999999999999
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_p
Model: Mistral: Mistral 7B Instruct v0.2
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-7B-Instruct-v0.2
Description: A high-performing, industry-standard 7.3B parameter model, with optimizations for speed and context length.

An improved version of [Mistral 7B Instruct](/modelsmistralai/mistral-7b-instruct-v0.1), with the following changes:

- 32k context window (vs 8k context in v0.1)
- Rope-theta = 1e6
- No Sliding-Window Attention
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.1999999999999999
Completion price per 1M tokens (USD): 0.1999999999999999
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.1999999999999999
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, stop, temperature, top_k, top_p
Model: Mistral: Mixtral 8x7B Instruct
Vendor: Mistral AI
Hugging Face ID: mistralai/Mixtral-8x7B-Instruct-v0.1
Description: Mixtral 8x7B Instruct is a pretrained generative Sparse Mixture of Experts, by Mistral AI, for chat and instruction use. Incorporates 8 experts (feed-forward networks) for a total of 47 billion parameters.

Instruct model fine-tuned by Mistral. #moe
Context length: 32768 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 16384.0
Prompt price per 1M tokens (USD): 0.54
Completion price per 1M tokens (USD): 0.54
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.54
Output/input cost ratio: 1.0
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: Noromaid 20B
Vendor: Neversleep
Hugging Face ID: NeverSleep/Noromaid-20b-v0.1.1
Description: A collab between IkariDev and Undi. This merge is suitable for RP, ERP, and general knowledge.

#merge #uncensored
Context length: 4096 tokens
Tokenizer: Llama2
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 1.0
Completion price per 1M tokens (USD): 1.75
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.375
Output/input cost ratio: 1.75
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_a, top_k, top_logprobs, top_p
Model: Goliath 120B
Vendor: Alpindale
Hugging Face ID: alpindale/goliath-120b
Description: A large LLM created by combining two fine-tuned Llama 70B models into one 120B model. Combines Xwin and Euryale.

Credits to
- [@chargoddard](https://huggingface.co/chargoddard) for developing the framework used to merge the model - [mergekit](https://github.com/cg123/mergekit).
- [@Undi95](https://huggingface.co/Undi95) for helping with the merge ratios.

#merge
Context length: 6144 tokens
Tokenizer: Llama2
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 512.0
Prompt price per 1M tokens (USD): 4.0
Completion price per 1M tokens (USD): 5.5
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 4.75
Output/input cost ratio: 1.38
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, min_p, presence_penalty, repetition_penalty, response_format, seed, stop, structured_outputs, temperature, top_a, top_k, top_logprobs, top_p
Model: Auto Router
Vendor: OpenRouter
Description: Your prompt will be processed by a meta-model and routed to one of dozens of models (see below), optimizing for the best possible output.

To see which model was used, visit [Activity](/activity), or read the `model` attribute of the response. Your response will be priced at the same rate as the routed model.

The meta-model is powered by [Not Diamond](https://docs.notdiamond.ai/docs/how-not-diamond-works). Learn more in our [docs](/docs/model-routing).

Requests will be routed to the following models:
- [openai/gpt-5](/openai/gpt-5)
- [openai/gpt-5-mini](/openai/gpt-5-mini)
- [openai/gpt-5-nano](/openai/gpt-5-nano)
- [openai/gpt-4.1-nano](/openai/gpt-4.1-nano)
- [openai/gpt-4.1](/openai/gpt-4.1)
- [openai/gpt-4.1-mini](/openai/gpt-4.1-mini)
- [openai/gpt-4.1](/openai/gpt-4.1)
- [openai/gpt-4o-mini](/openai/gpt-4o-mini)
- [openai/chatgpt-4o-latest](/openai/chatgpt-4o-latest)
- [anthropic/claude-3.5-haiku](/anthropic/claude-3.5-haiku)
- [anthropic/claude-opus-4-1](/anthropic/claude-opus-4-1)
- [anthropic/claude-sonnet-4-0](/anthropic/claude-sonnet-4-0)
- [anthropic/claude-3-7-sonnet-latest](/anthropic/claude-3-7-sonnet-latest)
- [google/gemini-2.5-pro](/google/gemini-2.5-pro)
- [google/gemini-2.5-flash](/google/gemini-2.5-flash)
- [mistral/mistral-large-latest](/mistral/mistral-large-latest)
- [mistral/mistral-medium-latest](/mistral/mistral-medium-latest)
- [mistral/mistral-small-latest](/mistral/mistral-small-latest)
- [mistralai/mistral-nemo](/mistralai/mistral-nemo)
- [x-ai/grok-3](/x-ai/grok-3)
- [x-ai/grok-3-mini](/x-ai/grok-3-mini)
- [x-ai/grok-4](/x-ai/grok-4)
- [deepseek/deepseek-r1](/deepseek/deepseek-r1)
- [meta-llama/llama-3.1-70b-instruct](/meta-llama/llama-3.1-70b-instruct)
- [meta-llama/llama-3.1-405b-instruct](/meta-llama/llama-3.1-405b-instruct)
- [mistralai/mixtral-8x22b-instruct](/mistralai/mixtral-8x22b-instruct)
- [perplexity/sonar](/perplexity/sonar)
- [cohere/command-r-plus](/cohere/command-r-plus)
- [cohere/command-r](/cohere/command-r)
Context length: 2000000 tokens
Tokenizer: Router
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): -1000000.0
Completion price per 1M tokens (USD): -1000000.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.0
Output/input cost ratio: 0.0
Model: OpenAI: GPT-4 Turbo (older v1106)
Vendor: OpenAI
Description: The latest GPT-4 Turbo model with vision capabilities. Vision requests can now use JSON mode and function calling.

Training data: up to April 2023.
Context length: 128000 tokens
Tokenizer: GPT
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 10.0
Completion price per 1M tokens (USD): 30.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 20.0
Output/input cost ratio: 3.0
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, tool_choice, tools, top_logprobs, top_p
Model: Mistral: Mistral 7B Instruct v0.1
Vendor: Mistral AI
Hugging Face ID: mistralai/Mistral-7B-Instruct-v0.1
Description: A 7.3B parameter model that outperforms Llama 2 13B on all benchmarks, with optimizations for speed and context length.
Context length: 2824 tokens
Tokenizer: Mistral
Modality: text->text
Input modalities: text
Output modalities: text
Prompt price per 1M tokens (USD): 0.11
Completion price per 1M tokens (USD): 0.19
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 0.15
Output/input cost ratio: 1.73
Supported parameters: frequency_penalty, logit_bias, max_tokens, min_p, presence_penalty, repetition_penalty, seed, stop, temperature, tool_choice, tools, top_k, top_p
Model: OpenAI: GPT-3.5 Turbo Instruct
Vendor: OpenAI
Description: This model is a variant of GPT-3.5 Turbo tuned for instructional prompts and omitting chat-related optimizations. Training data: up to Sep 2021.
Context length: 4095 tokens
Tokenizer: GPT
Modality: text->text
Input modalities: text
Output modalities: text
Max completion tokens (top provider): 4096.0
Prompt price per 1M tokens (USD): 1.5
Completion price per 1M tokens (USD): 2.0
Image price (USD): 0.0
Request price (USD): 0.0
Median price per 1M tokens (USD): 1.75
Output/input cost ratio: 1.33
Supported parameters: frequency_penalty, logit_bias, logprobs, max_tokens, presence_penalty, response_format, seed, stop, structured_outputs, temperature, top_logprobs, top_p