For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Sign inBook a demo
DocsReferenceChangelog
DocsReferenceChangelog
  • Getting Started
    • Overview
    • Quickstart
  • Explanation
    • Integrating Humanloop
  • Tutorials
    • Evaluate an Agent in the UI
    • Evaluate an Agent in code
    • Evaluate a RAG app
    • Capture user feedback
  • How-To Guides
    • Migrating from Humanloop
      • Run an Evaluation via the UI
      • Run an Evaluation via the API
      • Upload a Dataset from CSV
      • Create a Dataset via the API
      • Create a Dataset from existing Logs
      • Set up a code Evaluator
      • Set up LLM as a Judge
      • Set up a Human Evaluator
      • Run a Human Evaluation
      • Manage multiple reviewers
      • Compare and Debug Prompts
      • Set up CI/CD Evaluations
      • Spot-check your Logs
      • Use external Evaluators
      • Evaluate external logs
  • Reference
    • Deployment Options
    • Supported Models
    • Template Library
    • Vercel AI SDK
    • .prompt and .agent Files
    • Humanloop Runtime Environment
    • Security and Compliance
    • Data Management
    • Access roles (RBACs)
    • SSO and Authentication
    • LLMs.txt
LogoLogo
Sign inBook a demo
On this page
  • Setting up CI/CD Integration with GitHub Actions
  • Prerequisites
  • Steps to Set Up CI/CD Integration
How-To GuidesEvaluation

Set up CI/CD Evaluations

In this guide, we will walk through setting up CI/CD integration for Humanloop evaluations using GitHub Actions.

Was this page helpful?
Previous

Spot-check your Logs

How to create an Evaluation Run to review a sample of your Logs, ensuring your model generations remain high-quality.

Next
Built with

Setting up CI/CD Integration with GitHub Actions

Integrating Humanloop evaluations into your CI/CD pipeline allows you to automatically test your AI applications as part of your development workflow. This guide will walk you through setting up this integration using GitHub Actions.

Prerequisites

  • A GitHub repository for your project
  • A Humanloop account with access to Evaluations
  • A Prompt and Dataset set up in Humanloop
  • An Evaluator configured in Humanloop

Steps to Set Up CI/CD Integration

1

Create a GitHub Actions Workflow

In your GitHub repository, create a new file .github/workflows/humanloop-eval.yml with the following content:

Under Development

This content is currently under development. Please refer to our V4 documentation for the current docs.