Commit fe9e621
Foundry Evals integration for Python
Add evaluation framework with local and Foundry-hosted evaluator support:
- EvalItem/EvalResult core types with conversation splitting strategies
- @evaluator decorator for defining custom evaluation functions
- LocalEvaluator for running evaluations locally
- FoundryEvals provider for Azure AI Foundry hosted evaluations
- evaluate_agent() orchestration with expected values support
- evaluate_workflow() for multi-agent workflow evaluation
- Comprehensive test suite and evaluation samples
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>1 parent 7c85f98 commit fe9e621
19 files changed
Lines changed: 6508 additions & 75 deletions
File tree
- python
- packages
- azure-ai
- agent_framework_azure_ai
- tests
- core
- agent_framework
- _workflows
- tests
- core
- workflow
- samples/05-end-to-end/evaluation/foundry_evals
Lines changed: 10 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
11 | 11 | | |
12 | 12 | | |
13 | 13 | | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
14 | 20 | | |
15 | 21 | | |
16 | 22 | | |
| |||
31 | 37 | | |
32 | 38 | | |
33 | 39 | | |
| 40 | + | |
34 | 41 | | |
35 | 42 | | |
36 | 43 | | |
37 | 44 | | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
38 | 48 | | |
0 commit comments