> This page is for version v5.0 (default).
> For other versions, use one of these documentation indexes:
> - v5.0 (default): https://humanloop.com/docs/v5/llms.txt
> - v4.0: https://humanloop.com/docs/v4/llms.txt

> For clean Markdown of any page, append .md to the page URL.
> For a complete documentation index, see https://humanloop.com/docs/llms.txt.
> For AI client integration (Claude Code, Cursor, etc.), connect to the MCP server at https://humanloop.com/docs/_mcp/server.

> Learn how to set up a Human Evaluator in Humanloop. Human Evaluators allow your subject-matter experts and end-users to provide feedback on Prompt Logs.

Human Evaluators allow your subject-matter experts and end-users to provide feedback on Prompt Logs.
These Evaluators can be attached to Prompts and Evaluations.

## Creating a Human Evaluator

This section will bring you through creating and setting up a Human Evaluator.
As an example, we'll use a "Tone" Evaluator that allows feedback to be provided by
selecting from a list of options.

### Create a new Evaluator

* Click the **New** button at the bottom of the left-hand sidebar, select **Evaluator**, then select **Human**.

![New Evaluator dialog](/docs/_fern-img/43ad217e56b9b8097a33e8d9190738010ba442553ec9d349e0f06ad86bc14bdc.webp)

* Give the Evaluator a name when prompted in the sidebar, for example "Tone".

![Created Human Evaluator being renamed to "Tone"](/docs/_fern-img/6b0d266502b418baa3917520a2bfc1de461981af3c007c426d6edfd3bd85628f.webp)

### Define the Judgment Schema

After creating the Evaluator, you will automatically be taken to the Editor.
Here, you can define the schema detailing the kinds of judgments to be applied for the Evaluator.
The Evaluator will be initialized to a 5-point rating scale by default.

In this example, we'll set up a feedback schema for a "Tone" Evaluator.
See the [Return types documentation](/docs/explanation/evaluators#return-types) for more information on return types.

* Select **Multi-select** within the **Return type** dropdown. "Multi-select" allows you to apply multiple options to a single Log.
* Add the following options, and set the valence for each:
  * Enthusiastic \[positive]
  * Informative \[postiive]
  * Repetitive \[negative]
  * Technical \[negative]
* Update the instructions to "Select all options that apply to the output."

![Tone evaluator set up with options and instructions](/docs/_fern-img/f6c8b4d590cb4a6ce77e0ad2ec13ba77751524538421bb5085c55f6ac3ee7c24.webp)

### Save and deploy the Evaluator

* Click **Save** in the top-right corner.
* Enter "Tone multi-select v1" for the version name and "Added initial tone options" for the description. Click **Save**.

![Save dialog over the "Tone" Evaluator](/docs/_fern-img/b4a4358e228cbcf8acd4c7cb8e5910e3c0b4e35cfc412b1a8f9131c4e2883fdb.webp)

* Press **Deploy** in the next dialog.
* Select your default Environment (usually "production").
* Confirm your deployment.

![Dialog deploying the "Tone" Evaluator to the "production" Environment](/docs/_fern-img/cb274c51d3197df4f9342aa5548c028e9566aca8883e7e30f4056caf08711570.webp)

:tada: You've now created a Human Evaluator that can be used to collect feedback on Prompt Logs.

## Next steps

* [Use Human Evaluators in Evaluations](/docs/guides/evals/run-human-evaluation) to collect annotations on Prompt Logs from subject-matter experts.
* [Attach Human Evaluators to Prompts](/docs/tutorials/capture-user-feedback) to collect end-user feedback