Skip to content

perf(pi): steer to native tools + cache skill menu#699

Closed
gewenyu99 wants to merge 1 commit into
pi/tasks-subagentsfrom
pi/perf-tuning
Closed

perf(pi): steer to native tools + cache skill menu#699
gewenyu99 wants to merge 1 commit into
pi/tasks-subagentsfrom
pi/perf-tuning

Conversation

@gewenyu99

@gewenyu99 gewenyu99 commented Jun 20, 2026

Copy link
Copy Markdown
Collaborator

Epic #520 · perf parity (new sub-issue pending).

Problem

  • pi ran ~1.5× the anthropic wall-clock — the gap was turn-count overhead and shell-spirals, not parallelism (the anthropic SDK emits one tool_use per turn and doesn't batch).

Changes

  • Read-only tools marked executionMode: 'parallel' + a runtime rule to batch independent calls → fewer round-trips than the un-batching control.
  • Steer to native ls / find / grep; cache the skill menu.
  • Anti-spiral runtime rules in PI_RUNTIME_NOTES: inspect via read not shell · never retry a blocked command · only the project's own scripts · run bare in the project root.
  • pi rules moved into PI_RUNTIME_NOTES instead of the shared commandments.

Test plan

  • express-todo A/B: pi 203s / ~43 round-trips vs anthropic 242s / 64 turns.
  • No spirals on django / swift / nuxt; all exit 0 + create dashboards. Build + tests green.

@github-actions

Copy link
Copy Markdown

🧙 Wizard CI

Run the Wizard CI and test your changes against wizard-workbench example apps by replying with a GitHub comment using one of the following commands:

Test all apps:

  • /wizard-ci all

Test all apps in a directory:

  • /wizard-ci basic-integration
  • /wizard-ci error-tracking-upload-source-maps
  • /wizard-ci misc
  • /wizard-ci revenue

Test an individual app:

  • /wizard-ci basic-integration/android
  • /wizard-ci basic-integration/angular
  • /wizard-ci basic-integration/astro
Show more apps
  • /wizard-ci basic-integration/django
  • /wizard-ci basic-integration/fastapi
  • /wizard-ci basic-integration/flask
  • /wizard-ci basic-integration/javascript-node
  • /wizard-ci basic-integration/javascript-web
  • /wizard-ci basic-integration/laravel
  • /wizard-ci basic-integration/next-js
  • /wizard-ci basic-integration/nuxt
  • /wizard-ci basic-integration/python
  • /wizard-ci basic-integration/rails
  • /wizard-ci basic-integration/react-native
  • /wizard-ci basic-integration/react-router
  • /wizard-ci basic-integration/sveltekit
  • /wizard-ci basic-integration/swift
  • /wizard-ci basic-integration/tanstack-router
  • /wizard-ci basic-integration/tanstack-start
  • /wizard-ci basic-integration/vue
  • /wizard-ci error-tracking-upload-source-maps/android
  • /wizard-ci error-tracking-upload-source-maps/cicd-docker-node-raw
  • /wizard-ci error-tracking-upload-source-maps/cicd-github-actions-docker-node-raw
  • /wizard-ci error-tracking-upload-source-maps/cicd-github-actions-nested-docker-node-raw
  • /wizard-ci error-tracking-upload-source-maps/cicd-github-actions-node-raw
  • /wizard-ci error-tracking-upload-source-maps/cicd-gitlab-node-raw
  • /wizard-ci error-tracking-upload-source-maps/cicd-ssh-vps-node-raw
  • /wizard-ci error-tracking-upload-source-maps/flutter
  • /wizard-ci error-tracking-upload-source-maps/ios
  • /wizard-ci error-tracking-upload-source-maps/next
  • /wizard-ci error-tracking-upload-source-maps/next-no-posthog
  • /wizard-ci error-tracking-upload-source-maps/node-raw
  • /wizard-ci error-tracking-upload-source-maps/node-rollup
  • /wizard-ci error-tracking-upload-source-maps/node-rollup-typescript-plugin
  • /wizard-ci error-tracking-upload-source-maps/node-webpack
  • /wizard-ci error-tracking-upload-source-maps/nuxt-3-6
  • /wizard-ci error-tracking-upload-source-maps/nuxt-4-3
  • /wizard-ci error-tracking-upload-source-maps/react-native
  • /wizard-ci error-tracking-upload-source-maps/react-vite
  • /wizard-ci error-tracking-upload-source-maps/rust
  • /wizard-ci misc/quack-quack
  • /wizard-ci revenue/stripe

Results will be posted here when complete.

gewenyu99 commented Jun 20, 2026

Copy link
Copy Markdown
Collaborator Author

daniloc commented Jun 25, 2026

Copy link
Copy Markdown
Collaborator

I think it's fine for now but I'm a little allergic to so much prose living in TS string literals. maybe the long term solution is a prompts/docs library for the pi harness we reference by filename?

@gewenyu99

Copy link
Copy Markdown
Collaborator Author

@daniloc This is why we need ASS. The whole shape of this is yuck.

I will find a more elegant solution than this monstrosity though

gewenyu99 added a commit that referenced this pull request Jun 27, 2026
…eaks (#699)

PI_RUNTIME_NOTES steers pi to read-not-shell, synchronous installs, single
skill-menu fetch, and env-var (not literal) URLs — erasing the fence-retry spirals.
Adds the init banner + task-update parity; drops the background-install commandment.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@gewenyu99 gewenyu99 force-pushed the pi/tasks-subagents branch from 8682281 to f439e54 Compare June 27, 2026 01:16
@gewenyu99 gewenyu99 force-pushed the pi/perf-tuning branch 3 times, most recently from fb73f37 to c2aafa9 Compare June 27, 2026 02:24
@gewenyu99 gewenyu99 force-pushed the pi/tasks-subagents branch 2 times, most recently from 60b0620 to fa95f7d Compare June 30, 2026 19:03
…eaks (#699)

PI_RUNTIME_NOTES steers pi to read-not-shell, synchronous installs, single
skill-menu fetch, and env-var (not literal) URLs — erasing the fence-retry spirals.
Adds the init banner + task-update parity; drops the background-install commandment.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@gewenyu99

Copy link
Copy Markdown
Collaborator Author

Superseded — this landed on main in the harness/switchboard shape via #780 and #701.

@gewenyu99 gewenyu99 closed this Jul 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants