Skip to content

Conversation

@omkarmore83
Copy link
Contributor

Updating distillation demo to use foundry sdk.

- New demo using azure-ai-projects SDK instead of raw OpenAI SDK
- Uses DefaultAzureCredential for authentication (no API keys)
- Uses responses.create() API for inference
- Same evals and fine-tuning APIs as original demo
- Includes README comparing both approaches

Files:
- sarcasm_foundry.ipynb: Main notebook
- requirements.txt: azure-ai-projects, azure-identity, etc.
- .env.template: Configuration template
- .gitignore: Excludes .env, .venv, etc.
- Use azure-ai-projects SDK with DefaultAzureCredential (no API keys)
- Use responses.create() API for inference
- Simplified evals with normalized pass_threshold (0-1 scale)
- Remove eval_utils.py (no longer needed)
- Remove separate DistillingSarcasm_Foundry folder

Changes:
- sarcasm.ipynb: Complete rewrite using Foundry SDK
- requirements.txt: azure-ai-projects, azure-identity
- README.md: Updated documentation
- .env.template: New config template
- .gitignore: Updated patterns
@voutilad
Copy link
Collaborator

voutilad commented Feb 3, 2026

@omkarmore83 can you instead create a new demo from this? This is such a massive rewrite and will conflict with changes I need to merge that I just made for Model Monday's (adding Ministral-3b and using Developer Tier).

Your notebook changes also completely remove any output cells to illustrate what the notebook does without running it.

I'd also request dropping the "Comparison with Original Demo" section from the notebook as it's nonsensical.

@voutilad
Copy link
Collaborator

voutilad commented Feb 3, 2026

Actually, my Ministral-3b and Developer Tier changes are already merged...but my points about the overhaul of the notebook remain.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants