Skip to content

Commit fe9e621

Browse files
alliscodeCopilot
andcommitted
Foundry Evals integration for Python
Add evaluation framework with local and Foundry-hosted evaluator support: - EvalItem/EvalResult core types with conversation splitting strategies - @evaluator decorator for defining custom evaluation functions - LocalEvaluator for running evaluations locally - FoundryEvals provider for Azure AI Foundry hosted evaluations - evaluate_agent() orchestration with expected values support - evaluate_workflow() for multi-agent workflow evaluation - Comprehensive test suite and evaluation samples Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
1 parent 7c85f98 commit fe9e621

19 files changed

Lines changed: 6508 additions & 75 deletions

python/packages/azure-ai/agent_framework_azure_ai/__init__.py

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,12 @@
1111
AzureAIInferenceEmbeddingSettings,
1212
RawAzureAIInferenceEmbeddingClient,
1313
)
14+
from ._foundry_evals import (
15+
FoundryEvals,
16+
evaluate_foundry_target,
17+
evaluate_traces,
18+
setup_continuous_eval,
19+
)
1420
from ._foundry_memory_provider import FoundryMemoryProvider
1521
from ._project_provider import AzureAIProjectAgentProvider
1622
from ._shared import AzureAISettings
@@ -31,8 +37,12 @@
3137
"AzureAIProjectAgentOptions",
3238
"AzureAIProjectAgentProvider",
3339
"AzureAISettings",
40+
"FoundryEvals",
3441
"FoundryMemoryProvider",
3542
"RawAzureAIClient",
3643
"RawAzureAIInferenceEmbeddingClient",
3744
"__version__",
45+
"evaluate_foundry_target",
46+
"evaluate_traces",
47+
"setup_continuous_eval",
3848
]

0 commit comments

Comments
 (0)