!function(){function t(t){document.documentElement.setAttribute("data-theme",t)}var e=function(){var t=null;try{t=new URLSearchParams(window.location.search).get("docusaurus-theme")}catch(t){}return t}()||function(){var t=null;try{t=localStorage.getItem("theme")}catch(t){}return t}();t(null!==e?e:"light")}(),document.documentElement.setAttribute("data-announcement-bar-initially-dismissed",function(){try{return"true"===localStorage.getItem("docusaurus.announcement.dismiss")}catch(t){}return!1}())

[Skip to main content](#__docusaurus_skipToContent_fallback)

LangChain v0.2 is coming soon! Preview the new docs [here](/v0.2/docs/introduction/).

[

![🦜️🔗 Langchain](/v0.1/img/brand/wordmark.png)![🦜️🔗 Langchain](/v0.1/img/brand/wordmark-dark.png)

](/v0.1/)[Docs](/v0.1/docs/get_started/introduction/)[Use cases](/v0.1/docs/use_cases/)[Integrations](/v0.1/docs/integrations/platforms/)[API Reference](https://api.js.langchain.com)

[More](#)

*   [People](/v0.1/docs/people/)
*   [Community](/v0.1/docs/community/)
*   [Tutorials](/v0.1/docs/additional_resources/tutorials/)
*   [Contributing](/v0.1/docs/contributing/)

[v0.1](#)

*   [v0.2](https://js.langchain.com/v0.2/docs/introduction)
*   [v0.1](/v0.1/docs/get_started/introduction/)

[🦜🔗](#)

*   [LangSmith](https://smith.langchain.com)
*   [LangSmith Docs](https://docs.smith.langchain.com)
*   [LangChain Hub](https://smith.langchain.com/hub)
*   [LangServe](https://github.com/langchain-ai/langserve)
*   [Python Docs](https://python.langchain.com/)

[Chat](https://chatjs.langchain.com)[](https://github.com/langchain-ai/langchainjs)

Search

*   [Providers](/v0.1/docs/integrations/platforms/)
    
    *   [Providers](/v0.1/docs/integrations/platforms/)
    *   [Anthropic](/v0.1/docs/integrations/platforms/anthropic/)
    *   [AWS](/v0.1/docs/integrations/platforms/aws/)
    *   [Google](/v0.1/docs/integrations/platforms/google/)
    *   [Microsoft](/v0.1/docs/integrations/platforms/microsoft/)
    *   [OpenAI](/v0.1/docs/integrations/platforms/openai/)
*   [Components](/v0.1/docs/integrations/components/)
    
    *   [LLMs](/v0.1/docs/integrations/llms/)
        
        *   [LLMs](/v0.1/docs/integrations/llms/)
        *   [AI21](/v0.1/docs/integrations/llms/ai21/)
        *   [AlephAlpha](/v0.1/docs/integrations/llms/aleph_alpha/)
        *   [AWS SageMakerEndpoint](/v0.1/docs/integrations/llms/aws_sagemaker/)
        *   [Azure OpenAI](/v0.1/docs/integrations/llms/azure/)
        *   [Bedrock](/v0.1/docs/integrations/llms/bedrock/)
        *   [Cloudflare Workers AI](/v0.1/docs/integrations/llms/cloudflare_workersai/)
        *   [Cohere](/v0.1/docs/integrations/llms/cohere/)
        *   [Fake LLM](/v0.1/docs/integrations/llms/fake/)
        *   [Fireworks](/v0.1/docs/integrations/llms/fireworks/)
        *   [Friendli](/v0.1/docs/integrations/llms/friendli/)
        *   [(Legacy) Google PaLM/VertexAI](/v0.1/docs/integrations/llms/google_palm/)
        *   [Google Vertex AI](/v0.1/docs/integrations/llms/google_vertex_ai/)
        *   [Gradient AI](/v0.1/docs/integrations/llms/gradient_ai/)
        *   [HuggingFaceInference](/v0.1/docs/integrations/llms/huggingface_inference/)
        *   [Llama CPP](/v0.1/docs/integrations/llms/llama_cpp/)
        *   [NIBittensor](/v0.1/docs/integrations/llms/ni_bittensor/)
        *   [Ollama](/v0.1/docs/integrations/llms/ollama/)
        *   [OpenAI](/v0.1/docs/integrations/llms/openai/)
        *   [PromptLayer OpenAI](/v0.1/docs/integrations/llms/prompt_layer_openai/)
        *   [RaycastAI](/v0.1/docs/integrations/llms/raycast/)
        *   [Replicate](/v0.1/docs/integrations/llms/replicate/)
        *   [Together AI](/v0.1/docs/integrations/llms/togetherai/)
        *   [WatsonX AI](/v0.1/docs/integrations/llms/watsonx_ai/)
        *   [Writer](/v0.1/docs/integrations/llms/writer/)
        *   [YandexGPT](/v0.1/docs/integrations/llms/yandex/)
    *   [Chat models](/v0.1/docs/integrations/chat/)
        
    *   [Document loaders](/v0.1/docs/integrations/document_loaders/)
        
    *   [Document transformers](/v0.1/docs/integrations/document_transformers/)
        
    *   [Document compressors](/v0.1/docs/integrations/document_compressors/)
        
    *   [Text embedding models](/v0.1/docs/integrations/text_embedding/)
        
    *   [Vector stores](/v0.1/docs/integrations/vectorstores/)
        
    *   [Retrievers](/v0.1/docs/integrations/retrievers/)
        
    *   [Tools](/v0.1/docs/integrations/tools/)
        
    *   [Agents and toolkits](/v0.1/docs/integrations/toolkits/)
        
    *   [Chat Memory](/v0.1/docs/integrations/chat_memory/)
        
    *   [Stores](/v0.1/docs/integrations/stores/)
        

*   [](/v0.1/)
*   [Components](/v0.1/docs/integrations/components/)
*   [LLMs](/v0.1/docs/integrations/llms/)
*   Together AI

On this page

Together AI
===========

Here's an example of calling a Together AI model as an LLM:

    import { TogetherAI } from "@langchain/community/llms/togetherai";import { PromptTemplate } from "@langchain/core/prompts";const model = new TogetherAI({  model: "mistralai/Mixtral-8x7B-Instruct-v0.1",});const prompt = PromptTemplate.fromTemplate(`System: You are a helpful assistant.User: {input}.Assistant:`);const chain = prompt.pipe(model);const response = await chain.invoke({  input: `Tell me a joke about bears`,});console.log("response", response);/**response Sure, here's a bear joke for you: Why do bears hate shoes so much? Because they like to run around in their bear feet! */

#### API Reference:

*   [TogetherAI](https://api.js.langchain.com/classes/langchain_community_llms_togetherai.TogetherAI.html) from `@langchain/community/llms/togetherai`
*   [PromptTemplate](https://api.js.langchain.com/classes/langchain_core_prompts.PromptTemplate.html) from `@langchain/core/prompts`

info

You can see a LangSmith trace of this example [here](https://smith.langchain.com/public/f49160bd-a6cd-4234-96de-b8106a9e08a7/r)

You can run other models through Together by changing the `modelName` parameter.

You can find a full list of models on [Together's website](https://api.together.xyz/playground).

### Streaming[​](#streaming "Direct link to Streaming")

Together AI also supports streaming, this example demonstrates how to use this feature.

    import { TogetherAI } from "@langchain/community/llms/togetherai";import { ChatPromptTemplate } from "@langchain/core/prompts";const model = new TogetherAI({  model: "mistralai/Mixtral-8x7B-Instruct-v0.1",  streaming: true,});const prompt = ChatPromptTemplate.fromMessages([  ["ai", "You are a helpful assistant."],  [    "human",    `Tell me a joke about bears.Assistant:`,  ],]);const chain = prompt.pipe(model);const result = await chain.stream({});let fullText = "";for await (const item of result) {  console.log("stream item:", item);  fullText += item;}console.log(fullText);/**stream item:  Surestream item: ,stream item:  herestream item: 'stream item: sstream item:  astream item:  lightstream item: -stream item: heartstream item: edstream item:  bearstream item:  jokestream item:  forstream item:  youstream item: :stream item:stream item:stream item: Whystream item:  dostream item:  bearsstream item:  hatestream item:  shoesstream item:  sostream item:  muchstream item: ?stream item:stream item:stream item: Becausestream item:  theystream item:  likestream item:  tostream item:  runstream item:  aroundstream item:  instream item:  theirstream item:  bearstream item:  feetstream item: !stream item: 
 Sure, here's a light-hearted bear joke for you:Why do bears hate shoes so much?Because they like to run around in their bear feet!
 */

#### API Reference:

*   [TogetherAI](https://api.js.langchain.com/classes/langchain_community_llms_togetherai.TogetherAI.html) from `@langchain/community/llms/togetherai`
*   [ChatPromptTemplate](https://api.js.langchain.com/classes/langchain_core_prompts.ChatPromptTemplate.html) from `@langchain/core/prompts`

info

You can see a LangSmith trace of this example [here](https://smith.langchain.com/public/26b5716e-6f00-47c1-aa71-1838a1eddbd1/r)

* * *

#### Help us out by providing feedback on this documentation page:

[

Previous

Replicate

](/v0.1/docs/integrations/llms/replicate/)[

Next

WatsonX AI

](/v0.1/docs/integrations/llms/watsonx_ai/)

*   [Streaming](#streaming)

Community

*   [Discord](https://discord.gg/cU2adEyC7w)
*   [Twitter](https://twitter.com/LangChainAI)

GitHub

*   [Python](https://github.com/langchain-ai/langchain)
*   [JS/TS](https://github.com/langchain-ai/langchainjs)

More

*   [Homepage](https://langchain.com)
*   [Blog](https://blog.langchain.dev)

Copyright © 2024 LangChain, Inc.