Skip to main content

[ ![🦜️🔗 Langchain](/img/brand/wordmark.png) ![🦜️🔗
Langchain](/img/brand/wordmark-dark.png) ](/) [ Docs
](/docs/get_started/introduction) [ Use cases ](/docs/use_cases) [
Integrations ](/docs/integrations/platforms/) [ Guides
](/docs/guides/debugging) [ API  ](https://api.python.langchain.com)

More

  * [ People ](/docs/people/)
  * [ Versioning ](/docs/packages)
  * [ Changelog ](/docs/changelog)
  * [ Contributing ](/docs/contributing)
  * [ Templates ](/docs/templates/)
  * [ Cookbooks  ](https://github.com/langchain-ai/langchain/blob/master/cookbook/README.md)
  * [ Tutorials ](/docs/additional_resources/tutorials)
  * [ YouTube ](/docs/additional_resources/youtube)

🦜️🔗

  * [ LangSmith  ](https://smith.langchain.com)
  * [ LangSmith Docs  ](https://docs.smith.langchain.com/)
  * [ LangServe GitHub  ](https://github.com/langchain-ai/langserve)
  * [ Templates GitHub  ](https://github.com/langchain-ai/langchain/tree/master/templates)
  * [ Templates Hub  ](https://templates.langchain.com)
  * [ LangChain Hub  ](https://smith.langchain.com/hub)
  * [ JS/TS Docs  ](https://js.langchain.com)

[ 💬  ](https://chat.langchain.com) [ ](https://github.com/langchain-
ai/langchain)

Search

  * [ Get started ](/docs/get_started)

    * [ Introduction ](/docs/get_started/introduction)
    * [ Installation ](/docs/get_started/installation)
    * [ Quickstart ](/docs/get_started/quickstart)
    * [ Security ](/docs/security)
  * [ LangChain Expression Language ](/docs/expression_language/)

    * [ Get started ](/docs/expression_language/get_started)
    * [ Why use LCEL ](/docs/expression_language/why)
    * [ Interface ](/docs/expression_language/interface)
    * [ Streaming ](/docs/expression_language/streaming)
    * [ How to ](/docs/expression_language/how_to/)

    * [ Cookbook ](/docs/expression_language/cookbook/)

    * [ LangChain Expression Language (LCEL) ](/docs/expression_language/)
  * [ Modules ](/docs/modules/)

    * [ Model I/O ](/docs/modules/model_io/)

    * [ Retrieval ](/docs/modules/data_connection/)

    * [ Agents ](/docs/modules/agents/)

    * [ Chains ](/docs/modules/chains)
    * [ More ](/docs/modules/memory/)

  * [ LangServe ](/docs/langserve)
  * [ LangSmith ](/docs/langsmith/)

  * [ LangGraph ](/docs/langgraph)

  * [ ](/)
  * LangServe 

On this page

#  🦜️🏓 LangServe

[ ![Release Notes](https://img.shields.io/github/release/langchain-
ai/langserve) ](https://github.com/langchain-ai/langserve/releases) [
![Downloads](https://static.pepy.tech/badge/langserve/month)
](https://pepy.tech/project/langserve) [ ![Open
Issues](https://img.shields.io/github/issues-raw/langchain-ai/langserve)
](https://github.com/langchain-ai/langserve/issues) [
![](https://dcbadge.vercel.app/api/server/6adMQxSpJS?compact=true&style=flat)
](https://discord.com/channels/1038097195422978059/1170024642245832774)

🚩 We will be releasing a hosted version of LangServe for one-click deployments
of LangChain applications. [ Sign up here
](https://airtable.com/apppQ9p5XuujRl3wJ/shrABpHWdxry8Bacm) to get on the
waitlist.

##  Overview  ​

[ LangServe ](https://github.com/langchain-ai/langserve) helps developers
deploy ` LangChain ` [ runnables and chains
](https://python.langchain.com/docs/expression_language/) as a REST API.

This library is integrated with [ FastAPI ](https://fastapi.tiangolo.com/) and
uses [ pydantic ](https://docs.pydantic.dev/latest/) for data validation.

In addition, it provides a client that can be used to call into runnables
deployed on a server. A JavaScript client is available in [ LangChain.js
](https://js.langchain.com/docs/ecosystem/langserve) .

##  Features  ​

  * Input and Output schemas automatically inferred from your LangChain object, and enforced on every API call, with rich error messages 
  * API docs page with JSONSchema and Swagger (insert example link) 
  * Efficient ` /invoke/ ` , ` /batch/ ` and ` /stream/ ` endpoints with support for many concurrent requests on a sing