*   [](/v0.2/)
*   [How-to guides](/v0.2/docs/how_to/)
*   How to generate multiple embeddings per document

On this page

How to generate multiple embeddings per document
================================================

Prerequisites

This guide assumes familiarity with the following concepts:

*   [Retrievers](/v0.2/docs/concepts/#retrievers)
*   [Text splitters](/v0.2/docs/concepts/#text-splitters)
*   [Retrieval-augmented generation (RAG)](/v0.2/docs/tutorials/rag)

Embedding different representations of an original document, then returning the original document when any of the representations result in a search hit, can allow you to tune and improve your retrieval performance. LangChain has a base [`MultiVectorRetriever`](https://v02.api.js.langchain.com/classes/langchain_retrievers_multi_vector.MultiVectorRetriever.html) designed to do just this!

A lot of the complexity lies in how to create the multiple vectors per document. This guide covers some of the common ways to create those vectors and use the `MultiVectorRetriever`.

Some methods to create multiple vectors per document include:

*   smaller chunks: split a document into smaller chunks, and embed those (e.g. the [`ParentDocumentRetriever`](/v0.2/docs/how_to/parent_document_retriever))
*   summary: create a summary for each document, embed that along with (or instead of) the document
*   hypothetical questions: create hypothetical questions that each document would be appropriate to answer, embed those along with (or instead of) the document

Note that this also enables another method of adding embeddings - manually. This is great because you can explicitly add questions or queries that should lead to a document being recovered, giving you more control.

Smaller chunks[​](#smaller-chunks "Direct link to Smaller chunks")
------------------------------------------------------------------

Often times it can be useful to retrieve larger chunks of information, but embed smaller chunks. This allows for embeddings to capture the semantic meaning as closely as possible, but for as much context as possible to be passed downstream. NOTE: this is what the ParentDocumentRetriever does. Here we show what is going on under the hood.

tip

See [this section for general instructions on installing integration packages](/v0.2/docs/how_to/installation#installing-integration-packages).

*   npm
*   Yarn
*   pnpm

    npm install @langchain/openai @langchain/community

    yarn add @langchain/openai @langchain/community

    pnpm add @langchain/openai @langchain/community

    import * as uuid from "uuid";import { MultiVectorRetriever } from "langchain/retrievers/multi_vector";import { FaissStore } from "@langchain/community/vectorstores/faiss";import { OpenAIEmbeddings } from "@langchain/openai";import { RecursiveCharacterTextSplitter } from "@langchain/textsplitters";import { InMemoryStore } from "@langchain/core/stores";import { TextLoader } from "langchain/document_loaders/fs/text";import { Document } from "@langchain/core/documents";const textLoader = new TextLoader("../examples/state_of_the_union.txt");const parentDocuments = await textLoader.load();const splitter = new RecursiveCharacterTextSplitter({  chunkSize: 10000,  chunkOverlap: 20,});const docs = await splitter.splitDocuments(parentDocuments);const idKey = "doc_id";const docIds = docs.map((_) => uuid.v4());const childSplitter = new RecursiveCharacterTextSplitter({  chunkSize: 400,  chunkOverlap: 0,});const subDocs = [];for (let i = 0; i < docs.length; i += 1) {  const childDocs = await childSplitter.splitDocuments([docs[i]]);  const taggedChildDocs = childDocs.map((childDoc) => {    // eslint-disable-next-line no-param-reassign    childDoc.metadata[idKey] = docIds[i];    return childDoc;  });  subDocs.push(...taggedChildDocs);}// The byteStore to use to store the original chunksconst byteStore = new InMemoryStore<Uint8Array>();// The vectorstore to use to index the child chunksconst vectorstore = await FaissStore.fromDocuments(  subDocs,  new OpenAIEmbeddings());const retriever = new MultiVectorRetriever({  vectorstore,  byteStore,  idKey,  // Optional `k` parameter to search for more child documents in VectorStore.  // Note that this does not exactly correspond to the number of final (parent) documents  // retrieved, as multiple child documents can point to the same parent.  childK: 20,  // Optional `k` parameter to limit number of final, parent documents returned from this  // retriever and sent to LLM. This is an upper-bound, and the final count may be lower than this.  parentK: 5,});const keyValuePairs: [string, Document][] = docs.map((originalDoc, i) => [  docIds[i],  originalDoc,]);// Use the retriever to add the original chunks to the document storeawait retriever.docstore.mset(keyValuePairs);// Vectorstore alone retrieves the small chunksconst vectorstoreResult = await retriever.vectorstore.similaritySearch(  "justice breyer");console.log(vectorstoreResult[0].pageContent.length);/*  390*/// Retriever returns larger resultconst retrieverResult = await retriever.invoke("justice breyer");console.log(retrieverResult[0].pageContent.length);/*  9770*/

#### API Reference:

*   [MultiVectorRetriever](https://v02.api.js.langchain.com/classes/langchain_retrievers_multi_vector.MultiVectorRetriever.html) from `langchain/retrievers/multi_vector`
*   [FaissStore](https://v02.api.js.langchain.com/classes/langchain_community_vectorstores_faiss.FaissStore.html) from `@langchain/community/vectorstores/faiss`
*   [OpenAIEmbeddings](https://v02.api.js.langchain.com/classes/langchain_openai.OpenAIEmbeddings.html) from `@langchain/openai`
*   [RecursiveCharacterTextSplitter](https://v02.api.js.langchain.com/classes/langchain_textsplitters.RecursiveCharacterTextSplitter.html) from `@langchain/textsplitters`
*   [InMemoryStore](https://v02.api.js.langchain.com/classes/langchain_core_stores.InMemoryStore.html) from `@langchain/core/stores`
*   [TextLoader](https://v02.api.js.langchain.com/classes/langchain_document_loaders_fs_text.TextLoader.html) from `langchain/document_loaders/fs/text`
*   [Document](https://v02.api.js.langchain.com/classes/langchain_core_documents.Document.html) from `@langchain/core/documents`

Summary[​](#summary "Direct link to Summary")
---------------------------------------------

Oftentimes a summary may be able to distill more accurately what a chunk is about, leading to better retrieval. Here we show how to create summaries, and then embed those.

    import * as uuid from "uuid";import { ChatOpenAI, OpenAIEmbeddings } from "@langchain/openai";import { MultiVectorRetriever } from "langchain/retrievers/multi_vector";import { FaissStore } from "@langchain/community/vectorstores/faiss";import { RecursiveCharacterTextSplitter } from "@langchain/textsplitters";import { InMemoryStore } from "@langchain/core/stores";import { TextLoader } from "langchain/document_loaders/fs/text";import { PromptTemplate } from "@langchain/core/prompts";import { StringOutputParser } from "@langchain/core/output_parsers";import { RunnableSequence } from "@langchain/core/runnables";import { Document } from "@langchain/core/documents";const textLoader = new TextLoader("../examples/state_of_the_union.txt");const parentDocuments = await textLoader.load();const splitter = new RecursiveCharacterTextSplitter({  chunkSize: 10000,  chunkOverlap: 20,});const docs = await splitter.splitDocuments(parentDocuments);const chain = RunnableSequence.from([  { content: (doc: Document) => doc.pageContent },  PromptTemplate.fromTemplate(`Summarize the following document:\n\n{content}`),  new ChatOpenAI({    maxRetries: 0,  }),  new StringOutputParser(),]);const summaries = await chain.batch(docs, {  maxConcurrency: 5,});const idKey = "doc_id";const docIds = docs.map((_) => uuid.v4());const summaryDocs = summaries.map((summary, i) => {  const summaryDoc = new Document({    pageContent: summary,    metadata: {      [idKey]: docIds[i],    },  });  return summaryDoc;});// The byteStore to use to store the original chunksconst byteStore = new InMemoryStore<Uint8Array>();// The vectorstore to use to index the child chunksconst vectorstore = await FaissStore.fromDocuments(  summaryDocs,  new OpenAIEmbeddings());const retriever = new MultiVectorRetriever({  vectorstore,  byteStore,  idKey,});const keyValuePairs: [string, Document][] = docs.map((originalDoc, i) => [  docIds[i],  originalDoc,]);// Use the retriever to add the original chunks to the document storeawait retriever.docstore.mset(keyValuePairs);// We could also add the original chunks to the vectorstore if we wish// const taggedOriginalDocs = docs.map((doc, i) => {//   doc.metadata[idKey] = docIds[i];//   return doc;// });// retriever.vectorstore.addDocuments(taggedOriginalDocs);// Vectorstore alone retrieves the small chunksconst vectorstoreResult = await retriever.vectorstore.similaritySearch(  "justice breyer");console.log(vectorstoreResult[0].pageContent.length);/*  1118*/// Retriever returns larger resultconst retrieverResult = await retriever.invoke("justice breyer");console.log(retrieverResult[0].pageContent.length);/*  9770*/

#### API Reference:

*   [ChatOpenAI](https://v02.api.js.langchain.com/classes/langchain_openai.ChatOpenAI.html) from `@langchain/openai`
*   [OpenAIEmbeddings](https://v02.api.js.langchain.com/classes/langchain_openai.OpenAIEmbeddings.html) from `@langchain/openai`
*   [MultiVectorRetriever](https://v02.api.js.langchain.com/classes/langchain_retrievers_multi_vector.MultiVectorRetriever.html) from `langchain/retrievers/multi_vector`
*   [FaissStore](https://v02.api.js.langchain.com/classes/langchain_community_vectorstores_faiss.FaissStore.html) from `@langchain/community/vectorstores/faiss`
*   [RecursiveCharacterTextSplitter](https://v02.api.js.langchain.com/classes/langchain_textsplitters.RecursiveCharacterTextSplitter.html) from `@langchain/textsplitters`
*   [InMemoryStore](https://v02.api.js.langchain.com/classes/langchain_core_stores.InMemoryStore.html) from `@langchain/core/stores`
*   [TextLoader](https://v02.api.js.langchain.com/classes/langchain_document_loaders_fs_text.TextLoader.html) from `langchain/document_loaders/fs/text`
*   [PromptTemplate](https://v02.api.js.langchain.com/classes/langchain_core_prompts.PromptTemplate.html) from `@langchain/core/prompts`
*   [StringOutputParser](https://v02.api.js.langchain.com/classes/langchain_core_output_parsers.StringOutputParser.html) from `@langchain/core/output_parsers`
*   [RunnableSequence](https://v02.api.js.langchain.com/classes/langchain_core_runnables.RunnableSequence.html) from `@langchain/core/runnables`
*   [Document](https://v02.api.js.langchain.com/classes/langchain_core_documents.Document.html) from `@langchain/core/documents`

Hypothetical queries[​](#hypothetical-queries "Direct link to Hypothetical queries")
------------------------------------------------------------------------------------

An LLM can also be used to generate a list of hypothetical questions that could be asked of a particular document. These questions can then be embedded and used to retrieve the original document:

    import * as uuid from "uuid";import { ChatOpenAI, OpenAIEmbeddings } from "@langchain/openai";import { MultiVectorRetriever } from "langchain/retrievers/multi_vector";import { FaissStore } from "@langchain/community/vectorstores/faiss";import { RecursiveCharacterTextSplitter } from "@langchain/textsplitters";import { InMemoryStore } from "@langchain/core/stores";import { TextLoader } from "langchain/document_loaders/fs/text";import { PromptTemplate } from "@langchain/core/prompts";import { RunnableSequence } from "@langchain/core/runnables";import { Document } from "@langchain/core/documents";import { JsonKeyOutputFunctionsParser } from "@langchain/core/output_parsers/openai_functions";const textLoader = new TextLoader("../examples/state_of_the_union.txt");const parentDocuments = await textLoader.load();const splitter = new RecursiveCharacterTextSplitter({  chunkSize: 10000,  chunkOverlap: 20,});const docs = await splitter.splitDocuments(parentDocuments);const functionsSchema = [  {    name: "hypothetical_questions",    description: "Generate hypothetical questions",    parameters: {      type: "object",      properties: {        questions: {          type: "array",          items: {            type: "string",          },        },      },      required: ["questions"],    },  },];const functionCallingModel = new ChatOpenAI({  maxRetries: 0,  model: "gpt-4",}).bind({  functions: functionsSchema,  function_call: { name: "hypothetical_questions" },});const chain = RunnableSequence.from([  { content: (doc: Document) => doc.pageContent },  PromptTemplate.fromTemplate(    `Generate a list of 3 hypothetical questions that the below document could be used to answer:\n\n{content}`  ),  functionCallingModel,  new JsonKeyOutputFunctionsParser<string[]>({ attrName: "questions" }),]);const hypotheticalQuestions = await chain.batch(docs, {  maxConcurrency: 5,});const idKey = "doc_id";const docIds = docs.map((_) => uuid.v4());const hypotheticalQuestionDocs = hypotheticalQuestions  .map((questionArray, i) => {    const questionDocuments = questionArray.map((question) => {      const questionDocument = new Document({        pageContent: question,        metadata: {          [idKey]: docIds[i],        },      });      return questionDocument;    });    return questionDocuments;  })  .flat();// The byteStore to use to store the original chunksconst byteStore = new InMemoryStore<Uint8Array>();// The vectorstore to use to index the child chunksconst vectorstore = await FaissStore.fromDocuments(  hypotheticalQuestionDocs,  new OpenAIEmbeddings());const retriever = new MultiVectorRetriever({  vectorstore,  byteStore,  idKey,});const keyValuePairs: [string, Document][] = docs.map((originalDoc, i) => [  docIds[i],  originalDoc,]);// Use the retriever to add the original chunks to the document storeawait retriever.docstore.mset(keyValuePairs);// We could also add the original chunks to the vectorstore if we wish// const taggedOriginalDocs = docs.map((doc, i) => {//   doc.metadata[idKey] = docIds[i];//   return doc;// });// retriever.vectorstore.addDocuments(taggedOriginalDocs);// Vectorstore alone retrieves the small chunksconst vectorstoreResult = await retriever.vectorstore.similaritySearch(  "justice breyer");console.log(vectorstoreResult[0].pageContent);/*  "What measures will be taken to crack down on corporations overcharging American businesses and consumers?"*/// Retriever returns larger resultconst retrieverResult = await retriever.invoke("justice breyer");console.log(retrieverResult[0].pageContent.length);/*  9770*/

#### API Reference:

*   [ChatOpenAI](https://v02.api.js.langchain.com/classes/langchain_openai.ChatOpenAI.html) from `@langchain/openai`
*   [OpenAIEmbeddings](https://v02.api.js.langchain.com/classes/langchain_openai.OpenAIEmbeddings.html) from `@langchain/openai`
*   [MultiVectorRetriever](https://v02.api.js.langchain.com/classes/langchain_retrievers_multi_vector.MultiVectorRetriever.html) from `langchain/retrievers/multi_vector`
*   [FaissStore](https://v02.api.js.langchain.com/classes/langchain_community_vectorstores_faiss.FaissStore.html) from `@langchain/community/vectorstores/faiss`
*   [RecursiveCharacterTextSplitter](https://v02.api.js.langchain.com/classes/langchain_textsplitters.RecursiveCharacterTextSplitter.html) from `@langchain/textsplitters`
*   [InMemoryStore](https://v02.api.js.langchain.com/classes/langchain_core_stores.InMemoryStore.html) from `@langchain/core/stores`
*   [TextLoader](https://v02.api.js.langchain.com/classes/langchain_document_loaders_fs_text.TextLoader.html) from `langchain/document_loaders/fs/text`
*   [PromptTemplate](https://v02.api.js.langchain.com/classes/langchain_core_prompts.PromptTemplate.html) from `@langchain/core/prompts`
*   [RunnableSequence](https://v02.api.js.langchain.com/classes/langchain_core_runnables.RunnableSequence.html) from `@langchain/core/runnables`
*   [Document](https://v02.api.js.langchain.com/classes/langchain_core_documents.Document.html) from `@langchain/core/documents`
*   [JsonKeyOutputFunctionsParser](https://v02.api.js.langchain.com/classes/langchain_core_output_parsers_openai_functions.JsonKeyOutputFunctionsParser.html) from `@langchain/core/output_parsers/openai_functions`

Next steps[​](#next-steps "Direct link to Next steps")
------------------------------------------------------

You've now learned a few ways to generate multiple embeddings per document.

Next, check out the individual sections for deeper dives on specific retrievers, the [broader tutorial on RAG](/v0.2/docs/tutorials/rag), or this section to learn how to [create your own custom retriever over any data source](/v0.2/docs/how_to/custom_retriever/).

* * *

#### Was this page helpful?

  

#### You can also leave detailed feedback [on GitHub](https://github.com/langchain-ai/langchainjs/issues/new?assignees=&labels=03+-+Documentation&projects=&template=documentation.yml&title=DOC%3A+%3CPlease+write+a+comprehensive+title+after+the+%27DOC%3A+%27+prefix%3E).

[

Previous

How to migrate from legacy LangChain agents to LangGraph

](/v0.2/docs/how_to/migrate_agent)[

Next

How to pass multimodal data directly to models

](/v0.2/docs/how_to/multimodal_inputs)

*   [Smaller chunks](#smaller-chunks)
*   [Summary](#summary)
*   [Hypothetical queries](#hypothetical-queries)
*   [Next steps](#next-steps)