Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions docs/04-automated-evaluation.md
Original file line number Diff line number Diff line change
Expand Up @@ -395,12 +395,12 @@ The evaluation script integrates with GitHub Actions to automatically run evalua

Save the `appId`, `tenant`, and `password` values from the output — you will use them in the next steps.

Assign the **Azure AI User** role so the service principal can call the Foundry project API:
Assign the **Foundry User** role so the service principal can call the Foundry project API:

```powershell
az role assignment create `
--assignee "<appId>" `
--role "Azure AI User" `
--role "Foundry User" `
--scope "/subscriptions/<subscription-id>/resourceGroups/<resource-group>/providers/Microsoft.CognitiveServices/accounts/<ai-account-name>"
```

Expand Down Expand Up @@ -665,7 +665,7 @@ Create `experiments/automated/model_comparison.md` with:

**Resolution**:
- Run `az login` to refresh Azure credentials
- Verify the service principal has the **Azure AI User** role at the CognitiveServices account scope — this role has `Microsoft.CognitiveServices/*` wildcard data actions required for `AIServices/agents/write`. `Azure AI Developer` alone is **not sufficient**
- Verify the service principal has the **Foundry User** role at the CognitiveServices account scope — this role has `Microsoft.CognitiveServices/*` wildcard data actions required for `AIServices/agents/write`. `Azure AI Developer` alone is **not sufficient**
- Check `AZURE_AI_PROJECT_ENDPOINT` in `.env` file is correct and includes `/api/projects/<project>`

### OIDC login fails on PR workflows (`AADSTS700213`)
Expand Down