AFDocs fixes: improve llms-txt-coverage with complete customSets#41
Merged
rachaelrenk merged 3 commits intomainfrom May 8, 2026
Merged
AFDocs fixes: improve llms-txt-coverage with complete customSets#41rachaelrenk merged 3 commits intomainfrom
rachaelrenk merged 3 commits intomainfrom
Conversation
- Add root pages (index, quickstart) to the Getting Started custom set - Simplify Support custom set to use support-and-community/** glob instead of manually listing individual pages, which missed warp-preview-and-alpha-program - Fix indentation inconsistency in customSets config Co-Authored-By: Oz <oz-agent@warp.dev>
|
The latest updates on your projects. Learn more about Vercel for GitHub.
|
petradonka
approved these changes
May 8, 2026
/api is a custom Astro page, not a Starlight doc page, so it won't have a .md variant. This is expected and intentional. Co-Authored-By: Oz <oz-agent@warp.dev>
The upstream plugin only applied the `exclude` option to llms-small.txt. Our existing patch already extended it to llms-full.txt; this adds the same exclude pass to llms-custom.txt.ts so custom sets (e.g. the Support set) also skip pages that cause a stack overflow in hast-util-to-text. Fixes the build failure caused by `support-and-community/**` including the ~25k-line open-source-licenses page in the Support custom set. Co-Authored-By: Oz <oz-agent@warp.dev>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
AFDocs fixes: improve llms-txt-coverage
Problem
The AFDocs audit scored docs.warp.dev at 81/100 (B-) with the
llms-txt-coveragecheck warning that only 253/314 sitemap pages (81%) were covered by llms.txt custom sets.Root cause
support-and-communitycustom set manually listed individual page paths, missingwarp-preview-and-alpha-programindex,quickstart) were not included in any custom setChanges
indexandquickstartto the paths so root-level pages are coveredsupport-and-community/**glob, which catches the previously missingwarp-preview-and-alpha-programpage, automatically covers any future pages added undersupport-and-community/, and simplifies the configexcludetollms-small.txt. Our existing patch already extended it tollms-full.txt; this PR adds the sameexcludepass tollms-custom.txt.tsso custom sets (e.g. the Support set) also skip pages that cause a stack overflow inhast-util-to-text. This was needed because thesupport-and-community/**glob now includes the ~25k-lineopen-source-licensespage./apiformarkdown-url-support: Added amarkdown-url-supportentry toknown-exceptions.md—/apiis a custom Astro page (src/pages/api.astro), not a Starlight content page, so it intentionally has no.mdvariant.astro.config.mjsValidation
Conversation: https://app.warp.dev/conversation/0f796c11-8a3f-4534-a70c-da06e9eb8cbc
Run: https://oz.warp.dev/runs/019e0699-c126-7d4d-8335-0eeef90547f3
This PR was generated with Oz.