Agentic skills#73
Merged
andresmor-ms merged 11 commits intomainfrom May 6, 2026
Merged
Conversation
There was a problem hiding this comment.
Pull request overview
Adds an interactive benchmark-qed init wizard plus YAML rendering/validation and supporting “agentic skills” documentation to streamline workspace setup and configuration.
Changes:
- Introduces an interactive init flow (
benchmark-qed init <dir>) that scaffoldssettings.yaml,prompts/,input/, and.env. - Adds template-based YAML renderers + a basic YAML validator, plus a comprehensive test suite for rendering and CLI flows.
- Adds APM skill metadata/docs and a semversioner minor release entry.
Reviewed changes
Copilot reviewed 13 out of 13 changed files in this pull request and generated 9 comments.
Show a summary per file
| File | Description |
|---|---|
| tests/test_interactive_init.py | New tests for YAML renderers, validation, and end-to-end init CLI behavior. |
| benchmark_qed/cli/yaml_renderer.py | New YAML rendering functions for AutoQ/AutoE + basic structure/type validation. |
| benchmark_qed/cli/scaffold.py | Shared helpers for copying prompts, creating input/, and writing .env. |
| benchmark_qed/cli/interactive.py | New interactive wizard for building configs and writing scaffolded workspace files. |
| benchmark_qed/cli/init_config.py | Refactors to reuse shared scaffold helpers (copy_prompts, ensure_input_folder, write_env_file). |
| benchmark_qed/autoq/cli.py | Updates CLI doc examples for top-level assertion-stats / generate-assertions. |
| benchmark_qed/main.py | Registers new top-level init command. |
| apm.yml | Adds an APM project manifest. |
| .semversioner/next-release/minor-20260422214721711139.json | Declares a minor release for the new init/skills functionality. |
| .apm/skills/benchmark-qed-setup/references/config-reference.md | Adds a detailed configuration reference and best practices. |
| .apm/skills/benchmark-qed-setup/SKILL.md | Adds setup skill guidance and workflow steps. |
| .apm/skills/benchmark-qed-autoq/SKILL.md | Adds AutoQ skill guidance and command workflows. |
| .apm/skills/benchmark-qed-autoe/SKILL.md | Adds AutoE skill guidance and command workflows. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
natoverse
approved these changes
Apr 28, 2026
Collaborator
natoverse
left a comment
natoverse
left a comment
There was a problem hiding this comment.
Looks good. I think the skill organization is at the right level: one each for the core components, and extra capabilities for each can be added in as additional references.
We should probably add some smoke tests to ensure these things truly work cross-platform.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.