!function(){function t(t){document.documentElement.setAttribute("data-theme",t)}var e=function(){var t=null;try{t=new URLSearchParams(window.location.search).get("docusaurus-theme")}catch(t){}return t}()||function(){var t=null;try{t=localStorage.getItem("theme")}catch(t){}return t}();t(null!==e?e:"light")}(),document.documentElement.setAttribute("data-announcement-bar-initially-dismissed",function(){try{return"true"===localStorage.getItem("docusaurus.announcement.dismiss")}catch(t){}return!1}())

[Skip to main content](#__docusaurus_skipToContent_fallback)

LangChain v0.2 is coming soon! Preview the new docs [here](/v0.2/docs/introduction/).

[

![🦜️🔗 Langchain](/v0.1/img/brand/wordmark.png)![🦜️🔗 Langchain](/v0.1/img/brand/wordmark-dark.png)

](/v0.1/)[Docs](/v0.1/docs/get_started/introduction/)[Use cases](/v0.1/docs/use_cases/)[Integrations](/v0.1/docs/integrations/platforms/)[API Reference](https://api.js.langchain.com)

[More](#)

*   [People](/v0.1/docs/people/)
*   [Community](/v0.1/docs/community/)
*   [Tutorials](/v0.1/docs/additional_resources/tutorials/)
*   [Contributing](/v0.1/docs/contributing/)

[v0.1](#)

*   [v0.2](https://js.langchain.com/v0.2/docs/introduction)
*   [v0.1](/v0.1/docs/get_started/introduction/)

[🦜🔗](#)

*   [LangSmith](https://smith.langchain.com)
*   [LangSmith Docs](https://docs.smith.langchain.com)
*   [LangChain Hub](https://smith.langchain.com/hub)
*   [LangServe](https://github.com/langchain-ai/langserve)
*   [Python Docs](https://python.langchain.com/)

[Chat](https://chatjs.langchain.com)[](https://github.com/langchain-ai/langchainjs)

Search

*   [Providers](/v0.1/docs/integrations/platforms/)
    
    *   [Providers](/v0.1/docs/integrations/platforms/)
    *   [Anthropic](/v0.1/docs/integrations/platforms/anthropic/)
    *   [AWS](/v0.1/docs/integrations/platforms/aws/)
    *   [Google](/v0.1/docs/integrations/platforms/google/)
    *   [Microsoft](/v0.1/docs/integrations/platforms/microsoft/)
    *   [OpenAI](/v0.1/docs/integrations/platforms/openai/)
*   [Components](/v0.1/docs/integrations/components/)
    
    *   [LLMs](/v0.1/docs/integrations/llms/)
        
        *   [LLMs](/v0.1/docs/integrations/llms/)
        *   [AI21](/v0.1/docs/integrations/llms/ai21/)
        *   [AlephAlpha](/v0.1/docs/integrations/llms/aleph_alpha/)
        *   [AWS SageMakerEndpoint](/v0.1/docs/integrations/llms/aws_sagemaker/)
        *   [Azure OpenAI](/v0.1/docs/integrations/llms/azure/)
        *   [Bedrock](/v0.1/docs/integrations/llms/bedrock/)
        *   [Cloudflare Workers AI](/v0.1/docs/integrations/llms/cloudflare_workersai/)
        *   [Cohere](/v0.1/docs/integrations/llms/cohere/)
        *   [Fake LLM](/v0.1/docs/integrations/llms/fake/)
        *   [Fireworks](/v0.1/docs/integrations/llms/fireworks/)
        *   [Friendli](/v0.1/docs/integrations/llms/friendli/)
        *   [(Legacy) Google PaLM/VertexAI](/v0.1/docs/integrations/llms/google_palm/)
        *   [Google Vertex AI](/v0.1/docs/integrations/llms/google_vertex_ai/)
        *   [Gradient AI](/v0.1/docs/integrations/llms/gradient_ai/)
        *   [HuggingFaceInference](/v0.1/docs/integrations/llms/huggingface_inference/)
        *   [Llama CPP](/v0.1/docs/integrations/llms/llama_cpp/)
        *   [NIBittensor](/v0.1/docs/integrations/llms/ni_bittensor/)
        *   [Ollama](/v0.1/docs/integrations/llms/ollama/)
        *   [OpenAI](/v0.1/docs/integrations/llms/openai/)
        *   [PromptLayer OpenAI](/v0.1/docs/integrations/llms/prompt_layer_openai/)
        *   [RaycastAI](/v0.1/docs/integrations/llms/raycast/)
        *   [Replicate](/v0.1/docs/integrations/llms/replicate/)
        *   [Together AI](/v0.1/docs/integrations/llms/togetherai/)
        *   [WatsonX AI](/v0.1/docs/integrations/llms/watsonx_ai/)
        *   [Writer](/v0.1/docs/integrations/llms/writer/)
        *   [YandexGPT](/v0.1/docs/integrations/llms/yandex/)
    *   [Chat models](/v0.1/docs/integrations/chat/)
        
    *   [Document loaders](/v0.1/docs/integrations/document_loaders/)
        
    *   [Document transformers](/v0.1/docs/integrations/document_transformers/)
        
    *   [Document compressors](/v0.1/docs/integrations/document_compressors/)
        
    *   [Text embedding models](/v0.1/docs/integrations/text_embedding/)
        
    *   [Vector stores](/v0.1/docs/integrations/vectorstores/)
        
    *   [Retrievers](/v0.1/docs/integrations/retrievers/)
        
    *   [Tools](/v0.1/docs/integrations/tools/)
        
    *   [Agents and toolkits](/v0.1/docs/integrations/toolkits/)
        
    *   [Chat Memory](/v0.1/docs/integrations/chat_memory/)
        
    *   [Stores](/v0.1/docs/integrations/stores/)
        

*   [](/v0.1/)
*   [Components](/v0.1/docs/integrations/components/)
*   [LLMs](/v0.1/docs/integrations/llms/)
*   (Legacy) Google PaLM/VertexAI

On this page

Google PaLM
===========

note

This integration does not support `gemini-*` models. Check [Google AI](/v0.1/docs/integrations/chat/google_generativeai/) or [VertexAI](/v0.1/docs/integrations/llms/google_vertex_ai/).

The [Google PaLM API](https://developers.generativeai.google/products/palm) can be integrated by first installing the required packages:

tip

See [this section for general instructions on installing integration packages](/v0.1/docs/get_started/installation/#installing-integration-packages).

*   npm
*   Yarn
*   pnpm

    npm install google-auth-library @google-ai/generativelanguage @langchain/community

    yarn add google-auth-library @google-ai/generativelanguage @langchain/community

    pnpm add google-auth-library @google-ai/generativelanguage @langchain/community

Create an **API key** from [Google MakerSuite](https://makersuite.google.com/app/apikey). You can then set the key as `GOOGLE_PALM_API_KEY` environment variable or pass it as `apiKey` parameter while instantiating the model.

    import { GooglePaLM } from "@langchain/community/llms/googlepalm";export const run = async () => {  const model = new GooglePaLM({    apiKey: "<YOUR API KEY>", // or set it in environment variable as `GOOGLE_PALM_API_KEY`    // other params    temperature: 1, // OPTIONAL    model: "models/text-bison-001", // OPTIONAL    maxOutputTokens: 1024, // OPTIONAL    topK: 40, // OPTIONAL    topP: 3, // OPTIONAL    safetySettings: [      // OPTIONAL      {        category: "HARM_CATEGORY_DANGEROUS",        threshold: "BLOCK_MEDIUM_AND_ABOVE",      },    ],    stopSequences: ["stop"], // OPTIONAL  });  const res = await model.invoke(    "What would be a good company name for a company that makes colorful socks?"  );  console.log({ res });};

#### API Reference:

*   [GooglePaLM](https://api.js.langchain.com/classes/langchain_community_llms_googlepalm.GooglePaLM.html) from `@langchain/community/llms/googlepalm`

GooglePaLM
==========

Langchain.js supports two different authentication methods based on whether you're running in a Node.js environment or a web environment.

Setup[​](#setup "Direct link to Setup")
---------------------------------------

### Node.js[​](#nodejs "Direct link to Node.js")

To call Vertex AI models in Node, you'll need to install [Google's official auth client](https://www.npmjs.com/package/google-auth-library) as a peer dependency.

You should make sure the Vertex AI API is enabled for the relevant project and that you've authenticated to Google Cloud using one of these methods:

*   You are logged into an account (using `gcloud auth application-default login`) permitted to that project.
*   You are running on a machine using a service account that is permitted to the project.
*   You have downloaded the credentials for a service account that is permitted to the project and set the `GOOGLE_APPLICATION_CREDENTIALS` environment variable to the path of this file.

*   npm
*   Yarn
*   pnpm

    npm install google-auth-library

    yarn add google-auth-library

    pnpm add google-auth-library

### Web[​](#web "Direct link to Web")

To call Vertex AI models in web environments (like Edge functions), you'll need to install the [`web-auth-library`](https://github.com/kriasoft/web-auth-library) pacakge as a peer dependency:

*   npm
*   Yarn
*   pnpm

    npm install web-auth-library

    yarn add web-auth-library

    pnpm add web-auth-library

Then, you'll need to add your service account credentials directly as a `GOOGLE_VERTEX_AI_WEB_CREDENTIALS` environment variable:

    GOOGLE_VERTEX_AI_WEB_CREDENTIALS={"type":"service_account","project_id":"YOUR_PROJECT-12345",...}

You can also pass your credentials directly in code like this:

tip

See [this section for general instructions on installing integration packages](/v0.1/docs/get_started/installation/#installing-integration-packages).

*   npm
*   Yarn
*   pnpm

    npm install @langchain/community

    yarn add @langchain/community

    pnpm add @langchain/community

    import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai";const model = new GoogleVertexAI({  authOptions: {    credentials: {"type":"service_account","project_id":"YOUR_PROJECT-12345",...},  },});

Usage[​](#usage "Direct link to Usage")
---------------------------------------

Several models are available and can be specified by the `model` attribute in the constructor. These include:

*   text-bison (default)
*   text-bison-32k
*   code-gecko
*   code-bison

    import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai";// Or, if using the web entrypoint:// import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai/web";/* * Before running this, you should make sure you have created a * Google Cloud Project that is permitted to the Vertex AI API. * * You will also need permission to access this project / API. * Typically, this is done in one of three ways: * - You are logged into an account permitted to that project. * - You are running this on a machine using a service account permitted to *   the project. * - The `GOOGLE_APPLICATION_CREDENTIALS` environment variable is set to the *   path of a credentials file for a service account permitted to the project. */const model = new GoogleVertexAI({  temperature: 0.7,});const res = await model.invoke(  "What would be a good company name for a company that makes colorful socks?");console.log({ res });

#### API Reference:

*   [GoogleVertexAI](https://api.js.langchain.com/classes/langchain_community_llms_googlevertexai.GoogleVertexAI.html) from `@langchain/community/llms/googlevertexai`

Google also has separate models for their "Codey" code generation models.

The "code-gecko" model is useful for code completion:

    import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai";/* * Before running this, you should make sure you have created a * Google Cloud Project that is permitted to the Vertex AI API. * * You will also need permission to access this project / API. * Typically, this is done in one of three ways: * - You are logged into an account permitted to that project. * - You are running this on a machine using a service account permitted to *   the project. * - The `GOOGLE_APPLICATION_CREDENTIALS` environment variable is set to the *   path of a credentials file for a service account permitted to the project. */const model = new GoogleVertexAI({  model: "code-gecko",});const res = await model.invoke("for (let co=0;");console.log({ res });

#### API Reference:

*   [GoogleVertexAI](https://api.js.langchain.com/classes/langchain_community_llms_googlevertexai.GoogleVertexAI.html) from `@langchain/community/llms/googlevertexai`

While the "code-bison" model is better at larger code generation based on a text prompt:

    import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai";/* * Before running this, you should make sure you have created a * Google Cloud Project that is permitted to the Vertex AI API. * * You will also need permission to access this project / API. * Typically, this is done in one of three ways: * - You are logged into an account permitted to that project. * - You are running this on a machine using a service account permitted to *   the project. * - The `GOOGLE_APPLICATION_CREDENTIALS` environment variable is set to the *   path of a credentials file for a service account permitted to the project. */const model = new GoogleVertexAI({  model: "code-bison",  maxOutputTokens: 2048,});const res = await model.invoke(  "A Javascript function that counts from 1 to 10.");console.log({ res });

#### API Reference:

*   [GoogleVertexAI](https://api.js.langchain.com/classes/langchain_community_llms_googlevertexai.GoogleVertexAI.html) from `@langchain/community/llms/googlevertexai`

### Streaming[​](#streaming "Direct link to Streaming")

Streaming in multiple chunks is supported for faster responses:

    import { GoogleVertexAI } from "@langchain/community/llms/googlevertexai";const model = new GoogleVertexAI({  temperature: 0.7,});const stream = await model.stream(  "What would be a good company name for a company that makes colorful socks?");for await (const chunk of stream) {  console.log("\n---------\nChunk:\n---------\n", chunk);}/*  ---------  Chunk:  ---------    1. Toe-tally Awesome Socks  2. The Sock Drawer  3. Happy Feet  4.   ---------  Chunk:  ---------  Sock It to Me  5. Crazy Color Socks  6. Wild and Wacky Socks  7. Fu  ---------  Chunk:  ---------  nky Feet  8. Mismatched Socks  9. Rainbow Socks  10. Sole Mates  ---------  Chunk:  ---------  */

#### API Reference:

*   [GoogleVertexAI](https://api.js.langchain.com/classes/langchain_community_llms_googlevertexai.GoogleVertexAI.html) from `@langchain/community/llms/googlevertexai`

* * *

#### Help us out by providing feedback on this documentation page:

[

Previous

Friendli

](/v0.1/docs/integrations/llms/friendli/)[

Next

Google Vertex AI

](/v0.1/docs/integrations/llms/google_vertex_ai/)

*   [Setup](#setup)
    *   [Node.js](#nodejs)
    *   [Web](#web)
*   [Usage](#usage)
    *   [Streaming](#streaming)

Community

*   [Discord](https://discord.gg/cU2adEyC7w)
*   [Twitter](https://twitter.com/LangChainAI)

GitHub

*   [Python](https://github.com/langchain-ai/langchain)
*   [JS/TS](https://github.com/langchain-ai/langchainjs)

More

*   [Homepage](https://langchain.com)
*   [Blog](https://blog.langchain.dev)

Copyright © 2024 LangChain, Inc.