FM
FlowMarket
AI Agents Intermediate ⚡ 13 n8n Nodes

Evaluation metric example categorization

AI evaluation in n8n This is a template for n8n's evaluation feature. Evaluation is a technique for getting confidence that your AI workflow performs reliabl...

🔌 Nodes & Integrations Used (5)

Agent Lm Chat Open Ai Output Parser Structured Evaluation Trigger Evaluation

📖 Implementation & Setup Guide

AI evaluation in n8n

This is a template for n8n's [evaluation feature](https://docs.n8n.io/advanced-ai/evaluations/overview).

Evaluation is a technique for getting confidence that your AI workflow performs reliably, by running a test dataset containing different inputs through the workflow.

By calculating a metric (score) for each input, you can see where the workflow is performing well and where it isn't.

How it works

This template shows how to calculate a workflow evaluation metric: **whether a category matches the expected one**.

The workflow takes support tickets and generates a category and priority, which is then compared with the correct answers in the dataset.

  • We use an evaluation trigger to read in our dataset
  • It is wired up in parallel with the regular trigger so that the workflow can be started from either one. [More info](https://docs.n8n.io/advanced-ai/evaluations/tips-and-common-issues/#combining-multiple-triggers)
  • Once the category is generated by the agent, we check whether it matches the expected one in the dataset
  • Finally we pass this information back to n8n as a metric

⚡ How to import this workflow into n8n:

  1. Click the Direct Download JSON button above to save Evaluation metric example_ categorization.json.
  2. Log in to your n8n Cloud or self-hosted n8n instance.
  3. In your workflow canvas, click the menu in top-right and select Import from File (or paste the JSON directly).
  4. Configure your credentials (e.g. API keys, database URLs) in the corresponding node settings.
  5. Click Execute Workflow to test and switch to Active!

Related AI Agents Workflows

View All in AI Agents →