Tony20100/langchain_full huggingface dataset:
embeddings.google_palm.GooglePalmEmbeddings
Google's PaLM Embeddings APIs.
embeddings.gpt4all.GPT4AllEmbeddings
GPT4All embedding models.
embeddings.gradient_ai.GradientEmbeddings
Gradient.ai Embedding models.
embeddings.gradient_ai.TinyAsyncGradientEmbeddingClient(...)
Deprecated, TinyAsyncGradientEmbeddingClient was removed.
embeddings.huggingface.HuggingFaceBgeEmbeddings
HuggingFace sentence_transformers embedding models.
embeddings.huggingface.HuggingFaceEmbeddings
[Deprecated] HuggingFace sentence_transformers embedding models.
embeddings.huggingface.HuggingFaceInferenceAPIEmbeddings
Embed texts using the HuggingFace API.
embeddings.huggingface.HuggingFaceInstructEmbeddings
Wrapper around sentence_transformers embedding models.
embeddings.huggingface_hub.HuggingFaceHubEmbeddings
[Deprecated] HuggingFaceHub embedding models.
embeddings.infinity.InfinityEmbeddings
Self-hosted embedding models for infinity package.
embeddings.infinity.TinyAsyncOpenAIInfinityEmbeddingClient([...])
Helper tool to embed Infinity.
embeddings.infinity_local.InfinityEmbeddingsLocal
Optimized Infinity embedding models.
embeddings.ipex_llm.IpexLLMBgeEmbeddings
Wrapper around the BGE embedding model with IPEX-LLM optimizations on Intel CPUs and GPUs.
embeddings.itrex.QuantizedBgeEmbeddings
Leverage Itrex runtime to unlock the performance of compressed NLP models.
embeddings.javelin_ai_gateway.JavelinAIGatewayEmbeddings
Javelin AI Gateway embeddings.
embeddings.jina.JinaEmbeddings
Jina embedding models.
embeddings.johnsnowlabs.JohnSnowLabsEmbeddings
JohnSnowLabs embedding models
embeddings.laser.LaserEmbeddings
JohnSnowLabs embedding models
embeddings.laser.LaserEmbeddings
LASER Language-Agnostic SEntence Representations.
embeddings.llamacpp.LlamaCppEmbeddings
llama.cpp embedding models.
embeddings.llamafile.LlamafileEmbeddings
Llamafile lets you distribute and run large language models with a single file.
embeddings.llm_rails.LLMRailsEmbeddings
LLMRails embedding models.
embeddings.localai.LocalAIEmbeddings
LocalAI embedding models.
embeddings.minimax.MiniMaxEmbeddings
MiniMax's embedding service.
embeddings.mlflow.MlflowCohereEmbeddings
Cohere embedding LLMs in MLflow.
embeddings.mlflow.MlflowEmbeddings
Embedding LLMs in MLflow.
embeddings.mlflow_gateway.MlflowAIGatewayEmbeddings
MLflow AI Gateway embeddings.
embeddings.modelscope_hub.ModelScopeEmbeddings
ModelScopeHub embedding models.
embeddings.mosaicml.MosaicMLInstructorEmbeddings
MosaicML embedding service.
embeddings.nemo.NeMoEmbeddings
[Deprecated] NeMo embedding models.
embeddings.nlpcloud.NLPCloudEmbeddings
NLP Cloud embedding models.
embeddings.oci_generative_ai.OCIAuthType(value)
OCI authentication types as enumerator.
embeddings.oci_generative_ai.OCIGenAIEmbeddings
OCI embedding models.
embeddings.octoai_embeddings.OctoAIEmbeddings
OctoAI Compute Service embedding models.
embeddings.ollama.OllamaEmbeddings
Ollama locally runs large language models.
embeddings.openai.OpenAIEmbeddings
[Deprecated] OpenAI embedding models.
embeddings.openvino.OpenVINOBgeEmbeddings
OpenVNO BGE embedding models.
OpenVNO BGE embedding models.
embeddings.openvino.OpenVINOEmbeddings
OpenVINO embedding models.
embeddings.optimum_intel.QuantizedBiEncoderEmbeddings
Quantized bi-encoders embedding models.
embeddings.oracleai.OracleEmbeddings
Get Embeddings
embeddings.premai.PremAIEmbeddings
Prem's Embedding APIs
embeddings.sagemaker_endpoint.EmbeddingsContentHandler()
Content handler for LLM class.
embeddings.sagemaker_endpoint.SagemakerEndpointEmbeddings
Custom Sagemaker Inference Endpoints.
embeddings.sambanova.SambaStudioEmbeddings
SambaNova embedding models.
embeddings.self_hosted.SelfHostedEmbeddings
Custom embedding models on self-hosted remote hardware.
embeddings.self_hosted_hugging_face.SelfHostedHuggingFaceEmbeddings
HuggingFace embedding models on self-hosted remote hardware.
embeddings.self_hosted_hugging_face.SelfHostedHuggingFaceInstructEmbeddings
HuggingFace InstructEmbedding models on self-hosted remote hardware.
embeddings.solar.SolarEmbeddings
[Deprecated] Solar's embedding service.
embeddings.spacy_embeddings.SpacyEmbeddings
Embeddings by spaCy models.
embeddings.sparkllm.AssembleHeaderException(msg)
Exception raised for errors in the header assembly.
embeddings.sparkllm.SparkLLMTextEmbeddings
SparkLLM Text Embedding models.
embeddings.sparkllm.Url(host, path, schema)
embeddings.tensorflow_hub.TensorflowHubEmbeddings
TensorflowHub embedding models.
embeddings.text2vec.Text2vecEmbeddings
text2vec embedding models.
embeddings.titan_takeoff.Device(value)
Device to use for inference, cuda or cpu.
embeddings.titan_takeoff.MissingConsumerGroup
embeddings.titan_takeoff.MissingConsumerGroup
Exception raised when no consumer group is provided on initialization of TitanTakeoffEmbed or in embed request.
embeddings.titan_takeoff.ReaderConfig
Configuration for the reader to be deployed in Takeoff.
embeddings.titan_takeoff.TakeoffEmbeddingException
Custom exception for interfacing with Takeoff Embedding class.
embeddings.titan_takeoff.TitanTakeoffEmbed([...])
Interface with Takeoff Inference API for embedding models.
embeddings.vertexai.VertexAIEmbeddings
[Deprecated] Google Cloud VertexAI embedding models.
embeddings.volcengine.VolcanoEmbeddings
Volcengine Embeddings embedding models.
embeddings.voyageai.VoyageEmbeddings
[Deprecated] Voyage embedding models.
embeddings.xinference.XinferenceEmbeddings([...])
Xinference embedding models.
embeddings.yandex.YandexGPTEmbeddings
YandexGPT Embeddings models.
Functions¶
embeddings.dashscope.embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.google_palm.embed_with_retry(...)
Use tenacity to retry the completion call.
embeddings.jina.get_bytes_str(file_path)
embeddings.jina.is_local(url)
embeddings.localai.async_embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.localai.embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.minimax.embed_with_retry(...)
Use tenacity to retry the completion call.
embeddings.nemo.is_endpoint_live(url, ...)
Check if an endpoint is live by sending a GET request to the specified URL.
embeddings.openai.async_embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.openai.embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.openai.embed_with_retry(...)
Use tenacity to retry the embedding call.
embeddings.premai.create_prem_retry_decorator(...)
Create a retry decorator for PremAIEmbeddings.
embeddings.premai.embed_with_retry(embedder, ...)
Using tenacity for retry in embedding calls
embeddings.self_hosted_hugging_face.load_embedding_model(...)
Load the embedding model.
embeddings.solar.embed_with_retry(...)
Use tenacity to retry the completion call.
embeddings.voyageai.embed_with_retry(...)
Use tenacity to retry the embedding call.
langchain_community.example_selectors¶
Example selector implements logic for selecting examples to include them
in prompts.
This allows us to select examples that are most relevant to the input.
There could be multiple strategies for selecting examples. For example, one could
select examples based on the similarity of the input to the examples. Another
strategy could be to select examples based on the diversity of the examples.
Classes¶
example_selectors.ngram_overlap.NGramOverlapExampleSelector
Select and order examples based on ngram overlap score (sentence_bleu score from NLTK package).
Functions¶
example_selectors.ngram_overlap.ngram_overlap_score(...)
Compute ngram overlap score of source and example as sentence_bleu score from NLTK package.
langchain_community.graphs¶
Graphs provide a natural language interface to graph databases.
Classes¶
graphs.age_graph.AGEGraph(graph_name, conf)
Apache AGE wrapper for graph operations.
graphs.age_graph.AGEQueryException(exception)
Exception for the AGE queries.
graphs.arangodb_graph.ArangoGraph(db)
ArangoDB wrapper for graph operations.
graphs.falkordb_graph.FalkorDBGraph(database)
FalkorDB wrapper for graph operations.
graphs.graph_document.GraphDocument
Represents a graph document consisting of nodes and relationships.
graphs.graph_document.GraphDocument
Represents a graph document consisting of nodes and relationships.
graphs.graph_document.Node
Represents a node in a graph with associated properties.
graphs.graph_document.Relationship
Represents a directed relationship between two nodes in a graph.
graphs.graph_store.GraphStore()
Abstract class for graph operations.
graphs.gremlin_graph.GremlinGraph([url, ...])
Gremlin wrapper for graph operations.
graphs.hugegraph.HugeGraph([username, ...])
HugeGraph wrapper for graph operations.
graphs.index_creator.GraphIndexCreator
Functionality to create graph index.
graphs.kuzu_graph.KuzuGraph(db[, database])
Kùzu wrapper for graph operations.
graphs.memgraph_graph.MemgraphGraph(url, ...)
Memgraph wrapper for graph operations.
graphs.nebula_graph.NebulaGraph(space[, ...])
NebulaGraph wrapper for graph operations.
graphs.neo4j_graph.Neo4jGraph([url, ...])
Neo4j database wrapper for various graph operations.
graphs.neptune_graph.BaseNeptuneGraph()
Abstract base class for Neptune
graphs.neptune_graph.NeptuneAnalyticsGraph(...)
Neptune Analytics wrapper for graph operations.
graphs.neptune_graph.NeptuneGraph(host[, ...])
Neptune wrapper for graph operations.
graphs.neptune_graph.NeptuneQueryException(...)
Exception for the Neptune queries.
graphs.neptune_rdf_graph.NeptuneRdfGraph(host)
Neptune wrapper for RDF graph operations.
graphs.networkx_graph.KnowledgeTriple(...)
Knowledge triple in the graph.
graphs.networkx_graph.NetworkxEntityGraph([graph])
Networkx wrapper for entity graph operations.
graphs.ontotext_graphdb_graph.OntotextGraphDBGraph(...)
graphs.ontotext_graphdb_graph.OntotextGraphDBGraph(...)
Ontotext GraphDB https://graphdb.ontotext.com/ wrapper for graph operations.
graphs.rdf_graph.RdfGraph([source_file, ...])
RDFlib wrapper for graph operations.
graphs.tigergraph_graph.TigerGraph(conn)
TigerGraph wrapper for graph operations.
Functions¶
graphs.arangodb_graph.get_arangodb_client([...])
Get the Arango DB client from credentials.
graphs.neo4j_graph.clean_string_values(text)
graphs.neo4j_graph.value_sanitize(d)
Sanitize the input dictionary or list.
graphs.networkx_graph.get_entities(entity_str)
Extract entities from entity string.
graphs.networkx_graph.parse_triples(...)
Parse knowledge triples from the knowledge string.
langchain_community.indexes¶
Index is used to avoid writing duplicated content
into the vectostore and to avoid over-writing content if it’s unchanged.
Indexes also :
Create knowledge graphs from data.
Support indexing workflows from LangChain data loaders to vectorstores.
Importantly, Index keeps on working even if the content being written is derived
via a set of transformations from some source content (e.g., indexing children
documents that were derived from parent documents by chunking.)
Classes¶
indexes.base.RecordManager(namespace)
Abstract base class for a record manager.
langchain_community.llms¶
LLM classes provide
access to the large language model (LLM) APIs and services.
Class hierarchy:
BaseLanguageModel --> BaseLLM --> LLM --> <name>  # Examples: AI21, HuggingFaceHub, OpenAI
Main helpers:
LLMResult, PromptValue,
CallbackManagerForLLMRun, AsyncCallbackManagerForLLMRun,
CallbackManager, AsyncCallbackManager,
AIMessage, BaseMessage
Classes¶
CallbackManager, AsyncCallbackManager,
AIMessage, BaseMessage
Classes¶
llms.ai21.AI21
AI21 large language models.
llms.ai21.AI21PenaltyData
Parameters for AI21 penalty data.
llms.aleph_alpha.AlephAlpha
Aleph Alpha large language models.
llms.amazon_api_gateway.AmazonAPIGateway
Amazon API Gateway to access LLM models hosted on AWS.
llms.amazon_api_gateway.ContentHandlerAmazonAPIGateway()
Adapter to prepare the inputs from Langchain to a format that LLM model expects.
llms.anthropic.Anthropic
[Deprecated] Anthropic large language models.
llms.anyscale.Anyscale
Anyscale large language models.
llms.aphrodite.Aphrodite
Aphrodite language model.
llms.arcee.Arcee
Arcee's Domain Adapted Language Models (DALMs).
llms.aviary.Aviary
Aviary hosted models.
llms.aviary.AviaryBackend(backend_url, bearer)
Aviary backend.
llms.azureml_endpoint.AzureMLBaseEndpoint
Azure ML Online Endpoint models.
llms.azureml_endpoint.AzureMLEndpointApiType(value)
Azure ML endpoints API types.
llms.azureml_endpoint.AzureMLEndpointClient(...)
AzureML Managed Endpoint client.
llms.azureml_endpoint.AzureMLOnlineEndpoint
Azure ML Online Endpoint models.
llms.azureml_endpoint.ContentFormatterBase()
Transform request and response of AzureML endpoint to match with required schema.
llms.azureml_endpoint.CustomOpenAIContentFormatter()
Content formatter for models that use the OpenAI like API scheme.
llms.azureml_endpoint.DollyContentFormatter()
Content handler for the Dolly-v2-12b model
llms.azureml_endpoint.GPT2ContentFormatter()
Content handler for GPT2
llms.azureml_endpoint.GPT2ContentFormatter()
Content handler for GPT2
llms.azureml_endpoint.HFContentFormatter()
Content handler for LLMs from the HuggingFace catalog.
llms.azureml_endpoint.LlamaContentFormatter()
Deprecated: Kept for backwards compatibility
llms.azureml_endpoint.OSSContentFormatter()
Deprecated: Kept for backwards compatibility
llms.baichuan.BaichuanLLM
Baichuan large language models.
llms.baidu_qianfan_endpoint.QianfanLLMEndpoint
Baidu Qianfan hosted open source or customized models.
llms.bananadev.Banana
Banana large language models.
llms.baseten.Baseten
Baseten model
llms.beam.Beam
Beam API for gpt2 large language model.
llms.bedrock.Bedrock
[Deprecated] Bedrock models.
llms.bedrock.BedrockBase
Base class for Bedrock models.
llms.bedrock.LLMInputOutputAdapter()
Adapter class to prepare the inputs from Langchain to a format that LLM model expects.
llms.bigdl_llm.BigdlLLM
Wrapper around the BigdlLLM model
llms.bittensor.NIBittensorLLM
NIBittensor LLMs
llms.cerebriumai.CerebriumAI
CerebriumAI large language models.
llms.chatglm.ChatGLM
ChatGLM LLM service.
llms.chatglm3.ChatGLM3
ChatGLM3 LLM service.
llms.clarifai.Clarifai
Clarifai large language models.
llms.cloudflare_workersai.CloudflareWorkersAI
Cloudflare Workers AI service.
llms.cohere.BaseCohere
[Deprecated] Base class for Cohere models.
[Deprecated] Base class for Cohere models.
llms.cohere.Cohere
[Deprecated] Cohere large language models.
llms.ctransformers.CTransformers
C Transformers LLM models.
llms.ctranslate2.CTranslate2
CTranslate2 language model.
llms.databricks.Databricks
Databricks serving endpoint or a cluster driver proxy app for LLM.
llms.deepinfra.DeepInfra
DeepInfra models.
llms.deepsparse.DeepSparse
Neural Magic DeepSparse LLM interface.
llms.edenai.EdenAI
EdenAI models.
llms.exllamav2.ExLlamaV2
ExllamaV2 API.
llms.fake.FakeListLLM
Fake LLM for testing purposes.
llms.fake.FakeStreamingListLLM
Fake streaming list LLM for testing purposes.
llms.fireworks.Fireworks
[Deprecated] Fireworks models.
llms.forefrontai.ForefrontAI
ForefrontAI large language models.
llms.friendli.BaseFriendli
Base class of Friendli.
llms.friendli.Friendli
Friendli LLM.
llms.gigachat.GigaChat
GigaChat large language models API.
llms.google_palm.GooglePalm
[Deprecated] DEPRECATED: Use langchain_google_genai.GoogleGenerativeAI instead.
llms.gooseai.GooseAI
GooseAI large language models.
llms.gpt4all.GPT4All
GPT4All language models.
llms.gradient_ai.GradientLLM
Gradient.ai LLM Endpoints.
llms.gradient_ai.TrainResult
Train result.
llms.huggingface_endpoint.HuggingFaceEndpoint
[Deprecated] HuggingFace Endpoint.
llms.huggingface_hub.HuggingFaceHub
[Deprecated] HuggingFace Endpoint.
llms.huggingface_hub.HuggingFaceHub
[Deprecated] HuggingFaceHub  models.
llms.huggingface_pipeline.HuggingFacePipeline
[Deprecated] HuggingFace Pipeline API.
llms.huggingface_text_gen_inference.HuggingFaceTextGenInference
[Deprecated] HuggingFace text generation API.
llms.human.HumanInputLLM
User input as the response.
llms.ipex_llm.IpexLLM
IpexLLM model.
llms.javelin_ai_gateway.JavelinAIGateway
Javelin AI Gateway LLMs.
llms.javelin_ai_gateway.Params
Parameters for the Javelin AI Gateway LLM.
llms.koboldai.KoboldApiLLM
Kobold API language model.
llms.konko.Konko
Konko AI models.
llms.layerup_security.LayerupSecurity
Layerup Security LLM service.
llms.llamacpp.LlamaCpp
llama.cpp model.
llms.llamafile.Llamafile
Llamafile lets you distribute and run large language models with a single file.
llms.manifest.ManifestWrapper
HazyResearch's Manifest library.
llms.minimax.Minimax
Minimax large language models.
llms.minimax.MinimaxCommon
Common parameters for Minimax large language models.
llms.mlflow.Mlflow
MLflow LLM service.
llms.mlflow_ai_gateway.MlflowAIGateway
MLflow AI Gateway LLMs.
llms.mlflow_ai_gateway.Params
Parameters for the MLflow AI Gateway LLM.
llms.mlx_pipeline.MLXPipeline
MLX Pipeline API.
llms.modal.Modal
Modal large language models.
llms.moonshot.Moonshot
Modal large language models.
llms.moonshot.Moonshot
Moonshot large language models.
llms.moonshot.MoonshotCommon
Common parameters for Moonshot LLMs.
llms.mosaicml.MosaicML
MosaicML LLM service.
llms.nlpcloud.NLPCloud
NLPCloud large language models.
llms.oci_data_science_model_deployment_endpoint.OCIModelDeploymentLLM
Base class for LLM deployed on OCI Data Science Model Deployment.
llms.oci_data_science_model_deployment_endpoint.OCIModelDeploymentTGI
OCI Data Science Model Deployment TGI Endpoint.
llms.oci_data_science_model_deployment_endpoint.OCIModelDeploymentVLLM
VLLM deployed on OCI Data Science Model Deployment
llms.oci_generative_ai.OCIAuthType(value)
OCI authentication types as enumerator.
llms.oci_generative_ai.OCIGenAI
OCI large language models.
llms.oci_generative_ai.OCIGenAIBase
Base class for OCI GenAI models
llms.octoai_endpoint.OctoAIEndpoint
OctoAI LLM Endpoints - OpenAI compatible.
llms.ollama.Ollama
Ollama locally runs large language models.
llms.ollama.OllamaEndpointNotFoundError
Raised when the Ollama endpoint is not found.
llms.opaqueprompts.OpaquePrompts
LLM that uses OpaquePrompts to sanitize prompts.
llms.openai.AzureOpenAI
[Deprecated] Azure-specific OpenAI large language models.
llms.openai.BaseOpenAI
Base OpenAI large language model class.
llms.openai.OpenAI
[Deprecated] OpenAI large language models.
llms.openai.OpenAIChat
[Deprecated] OpenAI Chat large language models.
llms.openai.OpenAIChat
[Deprecated] OpenAI Chat large language models.
llms.openllm.IdentifyingParams
Parameters for identifying a model as a typed dict.
llms.openllm.OpenLLM
OpenLLM, supporting both in-process model instance and remote OpenLLM servers.
llms.openlm.OpenLM
OpenLM models.
llms.pai_eas_endpoint.PaiEasEndpoint
Langchain LLM class to help to access eass llm service.
llms.petals.Petals
Petals Bloom models.
llms.pipelineai.PipelineAI
PipelineAI large language models.
llms.predibase.Predibase
Use your Predibase models with Langchain.
llms.predictionguard.PredictionGuard
Prediction Guard large language models.
llms.promptlayer_openai.PromptLayerOpenAI
PromptLayer OpenAI large language models.
llms.promptlayer_openai.PromptLayerOpenAIChat
PromptLayer OpenAI large language models.
llms.replicate.Replicate
Replicate models.
llms.rwkv.RWKV
RWKV language models.
llms.sagemaker_endpoint.ContentHandlerBase()
Handler class to transform input from LLM to a format that SageMaker endpoint expects.
llms.sagemaker_endpoint.LLMContentHandler()
Content handler for LLM class.
llms.sagemaker_endpoint.LineIterator(stream)
Parse the byte stream input.
llms.sagemaker_endpoint.SagemakerEndpoint
Sagemaker Inference Endpoint models.
llms.sambanova.SSEndpointHandler(host_url, ...)
SambaNova Systems Interface for SambaStudio model endpoints.
llms.sambanova.SVEndpointHandler(host_url)
SambaNova Systems Interface for Sambaverse endpoint.
llms.sambanova.SambaStudio
llms.sambanova.SambaStudio
SambaStudio large language models.
llms.sambanova.Sambaverse
Sambaverse large language models.
llms.self_hosted.SelfHostedPipeline
Model inference on self-hosted remote hardware.
llms.self_hosted_hugging_face.SelfHostedHuggingFaceLLM
HuggingFace Pipeline API to run on self-hosted remote hardware.
llms.solar.Solar
Solar large language models.
llms.solar.SolarCommon
Common configuration for Solar LLMs.
llms.sparkllm.SparkLLM
iFlyTek Spark large language model.
llms.stochasticai.StochasticAI
StochasticAI large language models.
llms.symblai_nebula.Nebula
Nebula Service models.
llms.textgen.TextGen
Text generation models from WebUI.
llms.titan_takeoff.Device(value)
The device to use for inference, cuda or cpu
llms.titan_takeoff.ReaderConfig
Configuration for the reader to be deployed in Titan Takeoff API.
llms.titan_takeoff.TitanTakeoff
Titan Takeoff API LLMs.
llms.together.Together
[Deprecated] LLM models from Together.
llms.tongyi.Tongyi
Tongyi Qwen large language models.
llms.vertexai.VertexAI
[Deprecated] Google Vertex AI large language models.
llms.vertexai.VertexAIModelGarden
[Deprecated] Vertex AI Model Garden large language models.
llms.vllm.VLLM
VLLM language model.
llms.vllm.VLLMOpenAI
vLLM OpenAI-compatible API client
llms.volcengine_maas.VolcEngineMaasBase
Base class for VolcEngineMaas models.
Base class for VolcEngineMaas models.
llms.volcengine_maas.VolcEngineMaasLLM
volc engine maas hosts a plethora of models.
llms.watsonxllm.WatsonxLLM
[Deprecated] IBM watsonx.ai large language models.
llms.weight_only_quantization.WeightOnlyQuantPipeline
Weight only quantized model.
llms.writer.Writer
Writer large language models.
llms.xinference.Xinference
Xinference large-scale model inference service.
llms.yandex.YandexGPT
Yandex large language models.
llms.yuan2.Yuan2
Yuan2.0 language models.
Functions¶
llms.anyscale.create_llm_result(choices, ...)
Create the LLMResult from the choices and prompts.
llms.anyscale.update_token_usage(keys, ...)
Update token usage.
llms.aviary.get_completions(model, prompt[, ...])
Get completions from Aviary models.
llms.aviary.get_models()
List available models
llms.cohere.acompletion_with_retry(llm, **kwargs)
Use tenacity to retry the completion call.
llms.cohere.completion_with_retry(llm, **kwargs)
Use tenacity to retry the completion call.
llms.databricks.get_default_api_token()
Get the default Databricks personal access token.
llms.databricks.get_default_host()
Get the default Databricks workspace hostname.
llms.databricks.get_repl_context()
Get the notebook REPL context if running inside a Databricks notebook.
llms.fireworks.acompletion_with_retry(llm, ...)
Use tenacity to retry the completion call.
llms.fireworks.acompletion_with_retry_batching(...)
llms.fireworks.acompletion_with_retry_batching(...)
Use tenacity to retry the completion call.
llms.fireworks.acompletion_with_retry_streaming(...)
Use tenacity to retry the completion call for streaming.
llms.fireworks.completion_with_retry(llm, ...)
Use tenacity to retry the completion call.
llms.fireworks.completion_with_retry_batching(...)
Use tenacity to retry the completion call.
llms.fireworks.conditional_decorator(...)
Conditionally apply a decorator.
llms.google_palm.completion_with_retry(llm, ...)
Use tenacity to retry the completion call.
llms.koboldai.clean_url(url)
Remove trailing slash and /api from url if present.
llms.layerup_security.default_guardrail_violation_handler(...)
Default guardrail violation handler.
llms.loading.load_llm(file, **kwargs)
Load LLM from a file.
llms.loading.load_llm_from_config(config, ...)
Load LLM from Config Dict.
llms.openai.acompletion_with_retry(llm[, ...])
Use tenacity to retry the async completion call.
llms.openai.completion_with_retry(llm[, ...])
Use tenacity to retry the completion call.
llms.openai.update_token_usage(keys, ...)
Update token usage.
llms.symblai_nebula.completion_with_retry(...)
Use tenacity to retry the completion call.
llms.symblai_nebula.make_request(self, prompt)
Generate text from the model.
llms.tongyi.agenerate_with_last_element_mark(...)
Generate elements from an async iterable, and a boolean indicating if it is the last element.
llms.tongyi.astream_generate_with_retry(llm, ...)
Async version of stream_generate_with_retry.