References

Supported Models

Humanloop supports all the major large language model providers, including OpenAI, Anthropic, Google, Azure, and more. Additionally, you can use your own custom models with with the API and still benefit from the Humanloop platform.

Providers

Here is a summary of which providers are supported, and what information is available for each provider automatically.

ProviderModelsCost informationToken information
OpenAI
Anthropic
Google
Azure
Cohere
Llama
Groq
AWS BedrockBy request
CustomUser-definedUser-defined

Adding in more providers is driven by customer demand. If you have a specific provider or model you would like to see supported, please reach out to us at support@humanloop.com.

Models

The following are models that are integrated with Humanloop. This means that they can be used in the Prompt Editor and are callable through the Humanloop API. If you have a specific model you would like to see supported, please reach out to us atsupport@humanloop.com.

Remember, you can always use any model you want including your own self-hosted models, if you orchestrate the API calls yourself and log the data to Humanloop.

ProviderModelMax Prompt TokensMax Output TokensCost per Prompt TokenCost per Output TokenTool SupportImage Support
openaigpt-4o1280004096$0.000005$0.000015
openaigpt-481924096$0.00003$0.00006
openaigpt-4-turbo1280004096$0.00001$0.00003
openaigpt-4-turbo-2024-04-091280004096$0.00001$0.00003
openaigpt-4-32k327684096$0.00003$0.00003
openaigpt-4-1106-preview1280004096$0.00001$0.00003
openaigpt-4-0125-preview1280004096$0.00001$0.00003
openaigpt-4-vision1280004096$0.00001$0.00003
openaigpt-4-1106-vision-preview163854096$0.0000015$0.000002
openaigpt-3.5-turbo163854096$0.0000015$0.000002
openaigpt-3.5-turbo-instruct81924097$0.0000015$0.000002
openaibabbage-0021638416384$0.0000004$0.0000004
openaidavinci-0021638416384$0.000002$0.000002
openaift:gpt-3.5-turbo40974096$0.000003$0.000006
openaift:davinci-0021638416384$0.000002$0.000002
openaitext-moderation3276832768$0.000003$0.000004
anthropicclaude-3-opus-202402292000004096$0.000015$0.000075
anthropicclaude-3-sonnet-202402292000004096$0.000003$0.000015
anthropicclaude-3-haiku-202403072000004096$0.00000025$0.00000125
anthropicclaude-2.11000004096$0.00000025$0.000024
anthropicclaude-21000004096$0.000008$0.000024
anthropicclaude-instant-1.21000004096$0.000008$0.000024
anthropicclaude-instant-11000004096$0.0000008$0.0000024
googlegemini-pro-vision163842048$0.00000025$0.0000005
googlegemini-1.0-pro-vision163842048$0.00000025$0.0000005
googlegemini-pro327608192$0.00000025$0.0000005
googlegemini-1.0-pro327608192$0.00000025$0.0000005
googlegemini-1.5-pro-latest10000008192$0.00000025$0.0000005
googlegemini-1.5-pro10000008192$0.00000025$0.0000005
googlegemini-experimental10000008192$0.00000025$0.0000005
openai_azuregpt-4o1280004096$0.000005$0.000015
openai_azuregpt-4o-2024-05-131280004096$0.000005$0.000015
openai_azuregpt-4-turbo-2024-04-091280004096$0.00003$0.00006
openai_azuregpt-481924096$0.00003$0.00006
openai_azuregpt-4-031481924096$0.00003$0.00006
openai_azuregpt-4-32k327684096$0.00006$0.00012
openai_azuregpt-4-01251280004096$0.00001$0.00003
openai_azuregpt-4-11061280004096$0.00001$0.00003
openai_azuregpt-4-061381924096$0.00003$0.00006
openai_azuregpt-4-turbo1280004096$0.00001$0.00003
openai_azuregpt-4-turbo-vision1280004096$0.000003$0.000004
openai_azuregpt-4-vision1280004096$0.000003$0.000004
openai_azuregpt-35-turbo-1106163844096$0.0000015$0.000002
openai_azuregpt-35-turbo-0125163844096$0.0000005$0.0000015
openai_azuregpt-35-turbo-16k163844096$0.000003$0.000004
openai_azuregpt-35-turbo40974096$0.0000015$0.000002
openai_azuregpt-3.5-turbo-instruct40974096$0.0000015$0.000002
openai_azuregpt-35-turbo-instruct40974097$0.0000015$0.000002
coherecommand-r1280004000$0.0000005$0.0000015
coherecommand-light40964096$0.000015$0.000015
coherecommand-r-plus1280004000$0.000003$0.000015
coherecommand-nightly40964096$0.000015$0.000015
coherecommand40964096$0.000015$0.000015
coherecommand-medium-beta40964096$0.000015$0.000015
coherecommand-xlarge-beta40964096$0.000015$0.000015
groqmixtral-8x7b-327683276832768$0.0$0.0
groqllama3-8b-819281928192$0.0$0.0
groqllama3-70b-819281928192$0.0$0.0
groqllama2-70b-409640964096$0.0$0.0
groqgemma-7b-it81928192$0.0$0.0
replicatellama-3-70b-instruct81928192$0.00000065$0.00000275
replicatellama-3-70b81928192$0.00000065$0.00000275
replicatellama-3-8b-instruct81928192$0.00000005$0.00000025
replicatellama-3-8b81928192$0.00000005$0.00000025
replicatellama-2-70b40964096$0.00003$0.00006
replicatellama70b-v240964096N/AN/A
replicatemixtral-8x7b40964096N/AN/A