fix(site,docs): round-4 buyer-review defects#578
Conversation
- /docs now serves a real documentation index (links to on-site docs + canonical GitHub docs) instead of falling back to the homepage - Blog re-dated honestly (Updated 2026-07-16) and SPS figures reconciled to the live leaderboard (opinionsqa 0.877, subpop 0.858, globalopinionqa 0.813; generated 2026-07-17) - Homepage evidence section: subpop 0.831 -> 0.858, margins corrected, Pew card refreshed to the 2026-07-16 re-blend run (gaps 20.3/16.0/4.3, JSD 0.035, mean 0.208), gap phrasing no longer reads as an error bound, human/synthetic bars legible without color - README: panel_verdict success-path contradiction resolved (it IS emitted, per src/synth_panel/mcp/server.py), sampling-mode claim tightened, Docker pin -> :1.5.7 / :1.5, Versions table extended through the 1.5.x line, SynthBench section de-staled (0.90 claim, github.io links) - Hero copy: no-API-key claim scoped to run_prompt + <=3-persona polls - Calibration doc: example manifest bumped to 1.5.7, 4-model mix labeled as an example blend (not the leaderboard ensemble) - panel-run doc: --checkpoint-dir default matches actual CLI behavior (off unless passed; resume falls back to ~/.synthpanel/checkpoints) - /mcp: credential store path (~/.config/synthpanel/credentials.json) vs data dir (~/.synthpanel/) stated explicitly - sitemap: /docs added, blog lastmod bumped - Markdown renditions regenerated (scripts/render_site_markdown.py) Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
![chatgpt-codex-connector[bot]](https://avatars.githubusercontent.com/in/1144995?s=60&v=4){kind=small}
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 064e609bec
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
|
|
||
| | Version | Highlights | | ||
| |---------|-----------| | ||
| | 1.5.x *(current)* | `synthpanel mcp install --host auto` one-liner host registration; four canonical persona packs; deterministic `poll-summary` rollups; MCP auto-picks a fast model for ≥10-persona panels; `results list`/`results show` for the saved-results store; `python -m synthpanel` alias; fail-loud empty attachments and typed `response_schema` enforcement; synthesis routing follows the panel's provider; PyPI Trusted Publishing + auto-tag version-drift guard | |
There was a problem hiding this comment.
For users installing the advertised current release, 1.5.7, synthpanel mcp install --host auto is not available: CHANGELOG.md lines 64–75 place the entire multi-host/--host auto feature under Unreleased, after the 1.5.7 release. Listing it as the first highlight of the current 1.5.x package therefore sends PyPI users to a command their installed CLI cannot parse; label this highlight as unreleased or omit it until the release containing it is published.
Useful? React with 👍 / 👎.
2 participants
Fixes the defects surfaced by the round-4 outside buyer review. Every number was re-verified against the live leaderboard (https://synthbench.org/data/leaderboard.json, generated 2026-07-17) and the code in
src/synth_panel/before editing.Findings → fixes
/docsserved the homepage verbatimsite/docs/index.html(+ generated.mdrendition): short intro, cards for/docs/panel-run,/mcp,/docs/calibration,/recommended-models, and explicit GitHub links to the canonicaldocs/set (agent-quickstart, mcp, response-contract, structured-polling, production-operations, methodology, ensemble, reproducibility, model-packs, registry, migration-v1, synthbench-integration — all verified to exist). Added tositemap.xml.article:modified_time, JSON-LDdateModified, homepage Further-reading row, sitemaplastmod). Stale numbers refreshed (see #3).subpop_ensemble_3blend_20260716_192413.json, verified on GitHub main): option gaps 20.3/16.0/4.3 pts, item JSD 0.035, run mean JSD 0.208.panel_verdictsrc/synth_panel/mcp/server.pyattachespanel_verdictto the success envelope (build_panel_verdict→result["panel_verdict"]). The Agent Quick Start line saying "not yet emitted" now agrees with the v1.0.6 lede note.:0.11.0, calibration0.11.1):1.5.7/ floating:1.5(matches docker.yml's major.minor floats); calibration example manifest →synthpanel_version: 1.5.7; README Versions table extended through the 1.5.x line (summarized from CHANGELOG — 1.5.x, 1.4.0, 1.3.0, 1.2.0, 1.1.0, 1.0.6, 1.0.0, 0.12.0; nothing fabricated).--checkpoint-dirdefault contradiction on /docs/panel-run--helpin a fresh venv: omitting the flag runs without snapshots;~/.synthpanel/checkpoints(or$SYNTHPANEL_CHECKPOINT_ROOT) only applies to--resumewithout the flag. Table + prose now say exactly that.~/.config/synthpanel/credentials.json(mode 0600, persrc/synth_panel/credentials.py); data lives under~/.synthpanel/— both stated explicitly.Guardrails respected
src/untouched;site/mcp/index.htmledited surgically (one paragraph added in Data storage; no parameter listings touched).site/index.htmlregenerated viascripts/render_site.py; all.mdrenditions regenerated viascripts/render_site_markdown.py;docs/blog/authored markdown kept in sync.Verification
scripts/check_site_cli_sync.py— OK (19 subcommands).tests/test_site_*pass (45 tests); full non-acceptance suite: 3430 passed, 7 failed — the same 7 fail on a cleanmaincheckout (pre-existing, unrelated:test_mcp_stdio_sampling,test_seed,test_structured_output).🤖 Generated with Claude Code