Accuracy
Accuracy examples evaluate how well responses match expected outputs.
Accuracy averages cover returned scores. Before applying a threshold, verify that every requested iteration produced a result, as shown in the basic example.
| Example | Description |
|---|---|
| Basic Accuracy Evaluation | Demonstrates synchronous and asynchronous accuracy evaluations. |
| Comparison Accuracy Evaluation | Demonstrates accuracy evaluation for numeric comparison tasks. |
| Team Accuracy Evaluation | Demonstrates evaluating language routing accuracy for a team. |
| Given Answer Accuracy Evaluation | Demonstrates accuracy evaluation for a provided answer string. |
| Tool-Enabled Accuracy Evaluation | Demonstrates accuracy evaluation for an agent using calculator tools. |
| Db Logging | Demonstrates storing accuracy evaluation results in PostgreSQL. |
| Evaluator Agent | Demonstrates accuracy evaluation using a custom evaluator agent. |
| Accuracy Eval Metrics | Accumulate eval model metrics into the agent's run output alongside agent model metrics. |