Skip to content

Fix headless thinking replay and benchmark efficiency#742

Merged
ericleepi314 merged 1 commit into
mainfrom
fix/harbor-thinking-and-efficiency
Jul 23, 2026
Merged

Fix headless thinking replay and benchmark efficiency#742
ericleepi314 merged 1 commit into
mainfrom
fix/harbor-thinking-and-efficiency

Conversation

@ericleepi314

Copy link
Copy Markdown
Collaborator

Summary

  • preserve Anthropic signed thinking and redacted-thinking blocks across tool turns
  • emit thinking blocks in headless stream-json logs
  • preserve captured Bash output when detached descendants hold pipes open
  • apply the existing deferred-tool filter to actual model requests

Validation

  • 114 focused regression tests pass
  • 88/89 broader query/headless tests pass; the remaining unrelated test requires PyYAML in the host environment
  • Harbor pypi-server benchmark: reward 1.0, 7 model calls, 8 tool calls, 75.9s agent execution
  • benchmark artifact: eval/harbor/jobs/2026-07-23__01-38-54/pypi-server__UFBsWUn

@ericleepi314
ericleepi314 merged commit 398b44f into main Jul 23, 2026
@ericleepi314
ericleepi314 deleted the fix/harbor-thinking-and-efficiency branch July 23, 2026 08:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant