Skip to main content

LLMs

caution

You are currently on a page documenting the use of text completion models. Many of the latest and most popular models are chat completion models.

Unless you are specifically using more advanced prompting techniques, you are probably looking for this page instead.

LLMs are language models that takes a string as input and return a string as output.

info

If you'd like to write your own LLM, see this how-to. If you'd like to contribute an integration, see Contributing integrations.

All LLMs

NameDescription
AI21You can get started with AI21Labs' Jurassic family of models, as well...
AlephAlphaLangChain.js supports AlephAlpha's Luminous family of models. You'll ...
AWS SageMakerEndpointLangChain.js supports integration with AWS SageMaker-hosted endpoints...
Azure OpenAI[Azure
BedrockAmazon Bedrock is a fully managed
ChromeAIThis feature is experimental and is subject to change.
Cloudflare Workers AIThis will help you get started with Cloudflare Workers AI [text
CohereThis will help you get started with Cohere completion models (LLMs)
Deep InfraLangChain supports LLMs hosted by Deep Infra through the DeepInfra wr...
FireworksFireworks AI is an AI inference platform to run
FriendliFriendli enhances AI application performance and optimizes cost savin...
Google Vertex AIGoogle Vertex is a service that
Gradient AILangChain.js supports integration with Gradient AI. Check out Gradien...
HuggingFaceInferenceHere's an example of calling a HugggingFaceInference model as an LLM:
Layerup SecurityThe Layerup Security integration allows you to secure your calls to a...
Llama CPPOnly available on Node.js.
MistralAIMistral AI is a platform that offers hosting for
OllamaThis will help you get started with Ollama [text completion models
OpenAIOpenAI is an artificial
RaycastAINote: This is a community-built integration and is not officially sup...
ReplicateHere's an example of calling a Replicate model as an LLM:
Together AIYou are currently on a page documenting the use of Together AI models...
WatsonX AILangChain.js supports integration with IBM WatsonX AI. Checkout Watso...
WriterLangChain.js supports calling Writer LLMs.
YandexGPTLangChain.js supports calling YandexGPT LLMs.

Was this page helpful?


You can also leave detailed feedback on GitHub.