For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Sign inBook a demo
DocsReferenceChangelog
DocsReferenceChangelog
  • Getting Started
    • Overview
    • Quickstart
  • Explanation
    • Integrating Humanloop
  • Tutorials
    • Evaluate an Agent in the UI
    • Evaluate an Agent in code
    • Evaluate a RAG app
    • Capture user feedback
  • How-To Guides
    • Migrating from Humanloop
  • Reference
    • Deployment Options
    • Supported Models
    • Template Library
    • Vercel AI SDK
    • .prompt and .agent Files
    • Humanloop Runtime Environment
    • Security and Compliance
    • Data Management
    • Access roles (RBACs)
    • SSO and Authentication
    • LLMs.txt
LogoLogo
Sign inBook a demo
On this page
  • Providers
  • Models
Reference

Supported Models

Was this page helpful?
Previous

Template Library

The Library provides example Evaluators, Prompts and Tools which you can customize for your use cases.
Next
Built with

Humanloop supports all the major large language model providers, including OpenAI, Anthropic, Google, AWS Bedrock, Azure, and more. Additionally, you can use your own custom models with with the API and still benefit from the Humanloop platform.

Providers

Here is a summary of which providers are supported, and what information is available for each provider automatically.

ProviderModelsCost informationToken information
OpenAI✅✅✅
Anthropic✅✅✅
Google✅✅✅
Azure✅✅✅
Cohere✅✅✅
Llama✅
Groq✅
AWS BedrockAnthropic, Llama✅✅

Adding in more providers is driven by customer demand. If you have a specific provider or model you would like to see supported, please reach out to us at support@humanloop.com.

Models

The following are models that are integrated with Humanloop. This means that they can be used in the Prompt Editor and are callable through the Humanloop API. If you have a specific model you would like to see supported, please reach out to us at support@humanloop.com.

Remember, you can always use any model you want including your own self-hosted models, if you orchestrate the API calls yourself and log the data to Humanloop.

ProviderModelMax Prompt TokensMax Output TokensCost per Prompt TokenCost per Output TokenTool SupportImage Support
openaio1-preview12800032768$0.000015$0.00006❌❌
openaio1-mini12800065536$0.000003$0.000012❌❌
openaigpt-4.1104757632768$0.000002$0.000008✅✅
openaigpt-4.1-mini104757632768$0.0000004$0.0000016✅✅
openaigpt-4.1-nano104757632768$0.0000001$0.0000004✅✅
openaio3200000100000$0.00001$0.00004✅✅
openaio4-mini200000100000$0.0000011$0.0000044✅✅
openaigpt-4.5-preview12800016384$0.000075$0.00015✅✅
openaigpt-4o-64k-output-alpha12800064000$0.000006$0.000018✅✅
openaigpt-4o1280004096$0.000005$0.000015✅✅
openaigpt-4o-mini1280004096$0.00000015$0.0000006✅✅
openaigpt-481924096$0.00003$0.00006✅❌
openaigpt-4-turbo1280004096$0.00001$0.00003✅✅
openaigpt-4-turbo-2024-04-091280004096$0.00001$0.00003✅❌
openaigpt-4-32k327684096$0.00003$0.00003✅❌
openaigpt-4-1106-preview1280004096$0.00001$0.00003✅❌
openaigpt-4-0125-preview1280004096$0.00001$0.00003✅❌
openaigpt-4-vision1280004096$0.00001$0.00003✅✅
openaigpt-4-1106-vision-preview163854096$0.0000015$0.000002✅❌
openaigpt-3.5-turbo163854096$0.0000015$0.000002✅❌
openaigpt-3.5-turbo-instruct81924097$0.0000015$0.000002✅❌
openaibabbage-0021638416384$0.0000004$0.0000004✅❌
openaidavinci-0021638416384$0.000002$0.000002✅❌
openaift:gpt-3.5-turbo40974096$0.000003$0.000006✅❌
openaift:davinci-0021638416384$0.000002$0.000002✅❌
openaitext-moderation3276832768$0.000003$0.000004✅❌
anthropicclaude-3-5-sonnet-202410222000008192$0.000003$0.000015✅✅
anthropicclaude-3-5-sonnet-202406202000004096$0.000003$0.000015✅✅
anthropicclaude-3-5-haiku-202410222000008192$0.000003$0.000015✅✅
anthropicclaude-3-opus-202402292000004096$0.000015$0.000075✅❌
anthropicclaude-3-sonnet-202402292000004096$0.000003$0.000015✅❌
anthropicclaude-3-haiku-202403072000004096$0.00000025$0.00000125✅❌
anthropicclaude-2.11000004096$0.00000025$0.000024❌❌
anthropicclaude-21000004096$0.000008$0.000024❌❌
googlegemini-pro-vision163842048$0.00000025$0.0000005❌✅
googlegemini-1.0-pro-vision163842048$0.00000025$0.0000005❌✅
googlegemini-pro327608192$0.00000025$0.0000005❌❌
googlegemini-1.0-pro327608192$0.00000025$0.0000005❌❌
googlegemini-1.5-pro-latest10000008192$0.00000025$0.0000005❌❌
googlegemini-1.5-pro10000008192$0.00000025$0.0000005❌❌
googlegemini-1.5-flash10000008192$0.000000075$0.0000003✅✅
googlegemini-1.5-flash-8b10000008192$0.0000000375$0.00000015✅✅
googlegemini-2.5-pro-preview104857665536$0.00000125$0.00001✅✅
googlegemini-2.5-flash104857665536$0.00000015$0.0000006✅✅
openai_azureo1-preview12800032768$0.000015$0.00006❌❌
openai_azureo1-mini12800065536$0.000003$0.000012❌❌
openai_azuregpt-4.1104757632768$0.000002$0.000008✅✅
openai_azuregpt-4.1-mini104757632768$0.0000004$0.0000016✅✅
openai_azuregpt-4.1-nano104757632768$0.0000001$0.0000004✅✅
openai_azureo3200000100000$0.00001$0.00004✅✅
openai_azureo4-mini200000100000$0.0000011$0.0000044✅✅
openai_azuregpt-4o1280004096$0.000005$0.000015✅✅
openai_azuregpt-4o-2024-05-131280004096$0.000005$0.000015✅✅
openai_azuregpt-4-turbo-2024-04-091280004096$0.00003$0.00006✅✅
openai_azuregpt-481924096$0.00003$0.00006✅❌
openai_azuregpt-4-031481924096$0.00003$0.00006✅❌
openai_azuregpt-4-32k327684096$0.00006$0.00012✅❌
openai_azuregpt-4-01251280004096$0.00001$0.00003✅❌
openai_azuregpt-4-11061280004096$0.00001$0.00003✅❌
openai_azuregpt-4-061381924096$0.00003$0.00006✅❌
openai_azuregpt-4-turbo1280004096$0.00001$0.00003✅❌
openai_azuregpt-4-turbo-vision1280004096$0.000003$0.000004✅✅
openai_azuregpt-4-vision1280004096$0.000003$0.000004✅✅
openai_azureo3200000100000$0.00001$0.00004✅✅
openai_azureo4-mini200000100000$0.0000011$0.0000044✅✅
openai_azuregpt-35-turbo-1106163844096$0.0000015$0.000002✅❌
openai_azuregpt-35-turbo-0125163844096$0.0000005$0.0000015✅❌
openai_azuregpt-35-turbo-16k163844096$0.000003$0.000004✅❌
openai_azuregpt-35-turbo40974096$0.0000015$0.000002✅❌
openai_azuregpt-3.5-turbo-instruct40974096$0.0000015$0.000002✅❌
openai_azuregpt-35-turbo-instruct40974097$0.0000015$0.000002✅❌
coherecommand-r1280004000$0.0000005$0.0000015❌❌
coherecommand-light40964096$0.000015$0.000015❌❌
coherecommand-r-plus1280004000$0.000003$0.000015❌❌
coherecommand-nightly40964096$0.000015$0.000015❌❌
coherecommand40964096$0.000015$0.000015❌❌
coherecommand-medium-beta40964096$0.000015$0.000015❌❌
coherecommand-xlarge-beta40964096$0.000015$0.000015❌❌
groqllama-3.3-70b-versatile1310728192$0.0$0.0✅❌
groqllama-3.1-70b-versatile1310728192$0.0$0.0✅❌
groqllama-3.1-8b-instant1310728192$0.0$0.0✅❌
groqllama3-8b-819281928192$0.0$0.0✅❌
groqllama3-70b-819281928192$0.0$0.0✅❌
groqmeta-llama/llama-4-maverick-17b-128e-instruct1310728192$0.0$0.0✅✅
groqmeta-llama/llama-4-scout-17b-16e-instruct1310728192$0.0$0.0✅✅
groqmeta-llama/Llama-Guard-4-12B131072128$0.0$0.0❌✅
groqdeepseek-r1-distill-llama-70b1310728192$0.0$0.0❌❌
groqgemma2-9b-it81928192$0.0$0.0✅❌
replicatellama-3-70b-instruct81928192$0.00000065$0.00000275❌❌
replicatellama-3-70b81928192$0.00000065$0.00000275❌❌
replicatellama-3-8b-instruct81928192$0.00000005$0.00000025❌❌
replicatellama-3-8b81928192$0.00000005$0.00000025❌❌
replicatellama-2-70b40964096$0.00003$0.00006❌❌
replicatellama70b-v240964096N/AN/A❌❌
replicatemixtral-8x7b40964096N/AN/A❌❌
bedrock*anthropic.claude-3.5-sonnet2000004096$0.000003$0.000015✅✅
bedrock*anthropic.claude-3-5-haiku2000004096$0.000001$0.000005✅✅
bedrock*anthropic.claude-3-sonnet2000004096$0.000003$0.000015✅✅
bedrock*anthropic.claude-3-haiku2000004096$0.00000025$0.00000125✅✅
bedrock*anthropic.claude-3-opus2000004096$0.000015$0.000075✅✅
bedrock*meta.llama3-1-405b-instruct1310722048$0.00000532$0.000016✅❌
bedrock*meta.llama3-1-70b-instruct1310722048$0.00000022$0.00000022✅❌
bedrock*meta.llama3-1-8b-instruct1310722048$0.00000099$0.00000099✅❌
bedrock*deepseek.r1-v1:03276232762$0.00000135$0.0000054✅❌

* AWS Bedrock prices differ based on region. The prices listed are for us-west-2