For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Sign inBook a demo
DocsReferenceChangelog
DocsReferenceChangelog
  • Getting Started
    • Overview
    • Why Humanloop?
    • Quickstart Tutorial
  • Tutorials
    • Create your first GPT-4 App
    • ChatGPT clone with streaming
  • Guides
    • Create a Prompt
    • Fine-tune a model
    • Manage API keys
    • Invite collaborators
    • Deploy to environments
  • Core concepts
    • Prompts
    • Tools
    • Datasets
    • Evaluators
    • Logs
    • Environments
    • Key Concepts
  • Reference
    • Supported Models
    • Access Roles
    • .prompt files
    • Postman Workspace
LogoLogo
Sign inBook a demo
On this page
  • Providers
  • Models
Reference

Supported Models

Was this page helpful?
Previous

Access Roles

Next
Built with

Humanloop supports all the major large language model providers, including OpenAI, Anthropic, Google, AWS Bedrock, Azure, and more. Additionally, you can use your own custom models with with the API and still benefit from the Humanloop platform.

Providers

Here is a summary of which providers are supported, and what information is available for each provider automatically.

ProviderModelsCost informationToken information
OpenAI✅✅✅
Anthropic✅✅✅
Google✅✅✅
Azure✅✅✅
Cohere✅✅✅
Llama✅
Groq✅
AWS BedrockAnthropic, Llama✅✅

Adding in more providers is driven by customer demand. If you have a specific provider or model you would like to see supported, please reach out to us at support@humanloop.com.

Models

The following are models that are integrated with Humanloop. This means that they can be used in the Prompt Editor and are callable through the Humanloop API. If you have a specific model you would like to see supported, please reach out to us at support@humanloop.com.

Remember, you can always use any model you want including your own self-hosted models, if you orchestrate the API calls yourself and log the data to Humanloop.

ProviderModelMax Prompt TokensMax Output TokensCost per Prompt TokenCost per Output TokenTool SupportImage Support
openaio1-preview12800032768$0.000015$0.00006❌❌
openaio1-mini12800065536$0.000003$0.000012❌❌
openaigpt-4.1104757632768$0.000002$0.000008✅✅
openaigpt-4.1-mini104757632768$0.0000004$0.0000016✅✅
openaigpt-4.1-nano104757632768$0.0000001$0.0000004✅✅
openaio3200000100000$0.00001$0.00004✅✅
openaio4-mini200000100000$0.0000011$0.0000044✅✅
openaigpt-4.5-preview12800016384$0.000075$0.00015✅✅
openaigpt-4o-64k-output-alpha12800064000$0.000006$0.000018✅✅
openaigpt-4o1280004096$0.000005$0.000015✅✅
openaigpt-4o-mini1280004096$0.00000015$0.0000006✅✅
openaigpt-481924096$0.00003$0.00006✅❌
openaigpt-4-turbo1280004096$0.00001$0.00003✅✅
openaigpt-4-turbo-2024-04-091280004096$0.00001$0.00003✅❌
openaigpt-4-32k327684096$0.00003$0.00003✅❌
openaigpt-4-1106-preview1280004096$0.00001$0.00003✅❌
openaigpt-4-0125-preview1280004096$0.00001$0.00003✅❌
openaigpt-4-vision1280004096$0.00001$0.00003✅✅
openaigpt-4-1106-vision-preview163854096$0.0000015$0.000002✅❌
openaigpt-3.5-turbo163854096$0.0000015$0.000002✅❌
openaigpt-3.5-turbo-instruct81924097$0.0000015$0.000002✅❌
openaibabbage-0021638416384$0.0000004$0.0000004✅❌
openaidavinci-0021638416384$0.000002$0.000002✅❌
openaift:gpt-3.5-turbo40974096$0.000003$0.000006✅❌
openaift:davinci-0021638416384$0.000002$0.000002✅❌
openaitext-moderation3276832768$0.000003$0.000004✅❌
anthropicclaude-3-5-sonnet-202410222000008192$0.000003$0.000015✅✅
anthropicclaude-3-5-sonnet-202406202000004096$0.000003$0.000015✅✅
anthropicclaude-3-5-haiku-202410222000008192$0.000003$0.000015✅✅
anthropicclaude-3-opus-202402292000004096$0.000015$0.000075✅❌
anthropicclaude-3-sonnet-202402292000004096$0.000003$0.000015✅❌
anthropicclaude-3-haiku-202403072000004096$0.00000025$0.00000125✅❌
anthropicclaude-2.11000004096$0.00000025$0.000024❌❌
anthropicclaude-21000004096$0.000008$0.000024❌❌
googlegemini-pro-vision163842048$0.00000025$0.0000005❌✅
googlegemini-1.0-pro-vision163842048$0.00000025$0.0000005❌✅
googlegemini-pro327608192$0.00000025$0.0000005❌❌
googlegemini-1.0-pro327608192$0.00000025$0.0000005❌❌
googlegemini-1.5-pro-latest10000008192$0.00000025$0.0000005❌❌
googlegemini-1.5-pro10000008192$0.00000025$0.0000005❌❌
googlegemini-1.5-flash10000008192$0.000000075$0.0000003✅✅
googlegemini-1.5-flash-8b10000008192$0.0000000375$0.00000015✅✅
googlegemini-2.5-pro-preview104857665536$0.00000125$0.00001✅✅
googlegemini-2.5-flash104857665536$0.00000015$0.0000006✅✅
openai_azureo1-preview12800032768$0.000015$0.00006❌❌
openai_azureo1-mini12800065536$0.000003$0.000012❌❌
openai_azuregpt-4.1104757632768$0.000002$0.000008✅✅
openai_azuregpt-4.1-mini104757632768$0.0000004$0.0000016✅✅
openai_azuregpt-4.1-nano104757632768$0.0000001$0.0000004✅✅
openai_azureo3200000100000$0.00001$0.00004✅✅
openai_azureo4-mini200000100000$0.0000011$0.0000044✅✅
openai_azuregpt-4o1280004096$0.000005$0.000015✅✅
openai_azuregpt-4o-2024-05-131280004096$0.000005$0.000015✅✅
openai_azuregpt-4-turbo-2024-04-091280004096$0.00003$0.00006✅✅
openai_azuregpt-481924096$0.00003$0.00006✅❌
openai_azuregpt-4-031481924096$0.00003$0.00006✅❌
openai_azuregpt-4-32k327684096$0.00006$0.00012✅❌
openai_azuregpt-4-01251280004096$0.00001$0.00003✅❌
openai_azuregpt-4-11061280004096$0.00001$0.00003✅❌
openai_azuregpt-4-061381924096$0.00003$0.00006✅❌
openai_azuregpt-4-turbo1280004096$0.00001$0.00003✅❌
openai_azuregpt-4-turbo-vision1280004096$0.000003$0.000004✅✅
openai_azuregpt-4-vision1280004096$0.000003$0.000004✅✅
openai_azureo3200000100000$0.00001$0.00004✅✅
openai_azureo4-mini200000100000$0.0000011$0.0000044✅✅
openai_azuregpt-35-turbo-1106163844096$0.0000015$0.000002✅❌
openai_azuregpt-35-turbo-0125163844096$0.0000005$0.0000015✅❌
openai_azuregpt-35-turbo-16k163844096$0.000003$0.000004✅❌
openai_azuregpt-35-turbo40974096$0.0000015$0.000002✅❌
openai_azuregpt-3.5-turbo-instruct40974096$0.0000015$0.000002✅❌
openai_azuregpt-35-turbo-instruct40974097$0.0000015$0.000002✅❌
coherecommand-r1280004000$0.0000005$0.0000015❌❌
coherecommand-light40964096$0.000015$0.000015❌❌
coherecommand-r-plus1280004000$0.000003$0.000015❌❌
coherecommand-nightly40964096$0.000015$0.000015❌❌
coherecommand40964096$0.000015$0.000015❌❌
coherecommand-medium-beta40964096$0.000015$0.000015❌❌
coherecommand-xlarge-beta40964096$0.000015$0.000015❌❌
groqllama-3.3-70b-versatile1310728192$0.0$0.0✅❌
groqllama-3.1-70b-versatile1310728192$0.0$0.0✅❌
groqllama-3.1-8b-instant1310728192$0.0$0.0✅❌
groqllama3-8b-819281928192$0.0$0.0✅❌
groqllama3-70b-819281928192$0.0$0.0✅❌
groqmeta-llama/llama-4-maverick-17b-128e-instruct1310728192$0.0$0.0✅✅
groqmeta-llama/llama-4-scout-17b-16e-instruct1310728192$0.0$0.0✅✅
groqmeta-llama/Llama-Guard-4-12B131072128$0.0$0.0❌✅
groqdeepseek-r1-distill-llama-70b1310728192$0.0$0.0❌❌
groqgemma2-9b-it81928192$0.0$0.0✅❌
replicatellama-3-70b-instruct81928192$0.00000065$0.00000275❌❌
replicatellama-3-70b81928192$0.00000065$0.00000275❌❌
replicatellama-3-8b-instruct81928192$0.00000005$0.00000025❌❌
replicatellama-3-8b81928192$0.00000005$0.00000025❌❌
replicatellama-2-70b40964096$0.00003$0.00006❌❌
replicatellama70b-v240964096N/AN/A❌❌
replicatemixtral-8x7b40964096N/AN/A❌❌
bedrock*anthropic.claude-3.5-sonnet2000004096$0.000003$0.000015✅✅
bedrock*anthropic.claude-3-5-haiku2000004096$0.000001$0.000005✅✅
bedrock*anthropic.claude-3-sonnet2000004096$0.000003$0.000015✅✅
bedrock*anthropic.claude-3-haiku2000004096$0.00000025$0.00000125✅✅
bedrock*anthropic.claude-3-opus2000004096$0.000015$0.000075✅✅
bedrock*meta.llama3-1-405b-instruct1310722048$0.00000532$0.000016✅❌
bedrock*meta.llama3-1-70b-instruct1310722048$0.00000022$0.00000022✅❌
bedrock*meta.llama3-1-8b-instruct1310722048$0.00000099$0.00000099✅❌
bedrock*deepseek.r1-v1:03276232762$0.00000135$0.0000054✅❌

* AWS Bedrock prices differ based on region. The prices listed are for us-west-2