March

Gemini 2.5 Pro Experimental model

March 27th, 2025

We’ve added Google’s Gemini 2.5 Pro Experimental model to Humanloop!

Gemini 2.5 Pro Experimental ranks #1 on LMArena and features enhanced reasoning capabilities with a 1 million token context window. It excels in complex tasks like mathematics, science, and coding by reasoning through its thoughts before responding. To find out more, read the Google blog post.

Improved Log search

March 7th, 2025

We’ve improved search on Logs to make it easier to find specific Logs based on their content. You can select the search target in a dropdown beside the search box to search by inputs, output, messages, or metadata.

Select “All” in the search target dropdown beside the search box to search across all fields (emulating the previous behavior of our search bar).

Log from Vercel AI SDK via OpenTelemetry

March 7th, 2025

We’ve added support for importing OpenTelemetry traces from the Vercel AI SDK. This allows you to see the steps taken by any AI system in Humanloop.

To try it, you need to enable the experimental_telemetry flag for each Vercel AI SDK call and configure the OpenTelemetry SDK to instrument your code.

Follow our guide to the Vercel AI SDK to learn more.

New filters in Logs tab

March 6th, 2025

We’ve made filtering in Logs tab more intuitive and powerful with a revamped UI.

You can now filter logs by metadata key-value pairs, evaluator judgments, and more, making it easier to find exactly what you need.

To check it out, navigate to the Logs tab and click on the Filter button to quickly find the logs you need.