-
Notifications
You must be signed in to change notification settings - Fork 110
feat(ai-gateway): Add new getting started guide for proxying LLM traffic #5637
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
tomek-labuk
merged 90 commits into
release/ai-gateway-2.0
from
feat/ai-gw-2-0-get-started
Jun 30, 2026
Merged
Changes from all commits
Commits
Show all changes
90 commits
Select commit
Hold shift + click to select a range
d9fa871
feat(test): add setup and basic test
fabianrbz 007db60
refactor: the way we render md and html templates, read and compile the
fabianrbz 5512a2f
add some basic specs with a fixture app
fabianrbz 4d4ab8b
feat(tests): add specs for the table and feature_table blocks and ind…
fabianrbz c342722
fix specs
fabianrbz 11a9d69
feat(ai-gateway): add generated pages for v1
fabianrbz 025d2a0
feat(ai-gateway): add config files, update redirects and add url segment
fabianrbz 5a6d8f0
fix: min_version, validate the format, it should be "major.minor"
fabianrbz 4081025
feat: add major_version to frontmatter schemas
fabianrbz 2ac1c56
add support for patches to min_version
fabianrbz 6defe33
fix(insomnia): min_version in how-to
fabianrbz e0b607f
feat(ai-gateway): add major_release_calculator
fabianrbz fc089e3
remove(ai-gateway): unpublished how-to
fabianrbz 866f942
feat(major-release): load the release config file for older major
fabianrbz 4c47d8c
feat(major-release): set `canonical?: false` and `seo_noindex = true`
fabianrbz e5d05d0
feat(major-release): flag old major release pages as not being
fabianrbz 83cfc08
fix(major-release): remove ! from ai-gateway redirects, it skips the
fabianrbz 56e9cb7
feat(major-release): add old version banner to pages
fabianrbz 05869cf
feat(major-release): add a safeguard to the sitemap generator to prevent
fabianrbz 5dce685
feat(major-release): add specs
fabianrbz 1de1ade
feat(major-release): set priority to high, we want this generator to run
fabianrbz 362e22c
feat(major-release): filter releases, available_releases, etc by
fabianrbz 8379702
fix(operator): remove old and unneeded page
fabianrbz 7f3c77c
refactor: remove mesh generator and related classes, we no longer
fabianrbz 89fd456
feat(major-release): fix auto-generated pages generation, we don't care
fabianrbz 9289694
refactor(major-version): how product release info works
fabianrbz 1acb79f
feat(major-release): refactor some specs and code and add support for
fabianrbz d4792dd
feat(major-release): add releases to ai-gateway
fabianrbz 5ad7007
fix: use major.minor for min_version
fabianrbz 14a358a
feat(major-release): add support for major_version to
fabianrbz f362201
fix(major-release): update old ai-gateway landing page to use a
fabianrbz aea4c35
feat(major-release): add placeholder prereq and cleanup for ai-gateway
fabianrbz f15ec6e
fat(major-release): remove ai-gateway how-tos, except the get-started
fabianrbz 90714d6
feat(ai-gateway): add ai-gateway icon
fabianrbz d82e95e
feat(ai-gateway): add placeholder get started guide
fabianrbz 7c726da
feat(major-release): add tests for drops/prereqs and refactor it to load
fabianrbz 6f22654
refactor(major-release): prereqs - how product_entities work, and how…
fabianrbz 4b7e195
feat(major-release): refactor ai-gateway product prereq
fabianrbz 30b6081
refactor(major-release): the way we decide how to render gateway prereq
fabianrbz e9c33eb
refactor(major-release): the way we calculate products prereqs so that
fabianrbz 03f5b94
fix(major-release): add missing redirects
fabianrbz 4da604f
fix(ai-gateway): use full product name in prereq
fabianrbz 325e9ca
fix: wrong new_in badges, they had a missing version
fabianrbz bf1923d
fix(major-release): only render version banner if page has a canonical
fabianrbz 6d837b2
fix(major-release): use a regex when checking redirects and log a
fabianrbz cb0f55b
fix(major-release): this how to shouldn't be here, it's not an
fabianrbz 93de7e5
fix(major-release): remove unneeded class
fabianrbz 4bad2e1
feat(major-release): load entity_examples in prereqs based on the major
fabianrbz 3fedad9
fix(ai-gateway): move metering-and-billing/meter-llm-traffic to the
fabianrbz 4cfd7e0
feat(major-release): move mcp how-tos to /gateway/v1/
fabianrbz e33a78f
feat(major-release): add _landing_pages/ai-gateway/v1/mcp.yaml
fabianrbz 84c3851
fix(major-release): expose the `products` available in the prereqs
fabianrbz d197aa1
fix: remove breadcrumbs from the how-to
fabianrbz 9c25cc2
fix(major-release): the way how_to_list and reference_list calculate the
fabianrbz 0a26af8
fix(major-release): remove how_to_list from ai pages
fabianrbz 174f33a
fix(major-release): scope releases to latest - excluding unreleased
fabianrbz 686b1d4
feat(major-release): always render the major version banner even if the
fabianrbz e1adfd7
fix(major-release): add comment explaining how app/_config/releases work
fabianrbz 2ee55dc
fix(major-release): when loading major releases config
fabianrbz c6ff4c5
feat(ai-gateway): AI Gateway 2.0 entities (#5263)
tomek-labuk 54170b9
update agent and mcp server entities
tomek-labuk fda5b4e
update mcp server
tomek-labuk c9d5d01
Remove on-prem mentions
tomek-labuk 3c93165
feat(ai-gateway): Update load balancing capabilities documentation fo…
tomek-labuk 42bb5d1
update min_version
tomek-labuk f7722fe
Update min_version for Resource sizing guidelines doc
tomek-labuk 57fac3f
feat(ai-gateway): Align semantic similarity documentation with AI GW …
tomek-labuk 57c9b79
fix(ai-gateway): remove uneeded cleanup step in ai-gateway-get-started
fabianrbz 1f145b8
Add new getting started guide for 2.0
tomek-labuk 751d66e
Add includes and appease vale
tomek-labuk 05a5c4a
update file
tomek-labuk 3bc5915
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk ea5a37a
delete unused how-to
tomek-labuk a1aa23c
Update prereqs
tomek-labuk 106c499
add get started for mcp
tomek-labuk da813c6
appease vale
tomek-labuk dfd3ea3
fix
tomek-labuk 512d23b
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk 5f878a2
Delete cleanup include
tomek-labuk ed6afa9
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk c8199f2
Update getting started guides with working configs
tomek-labuk 62a0725
Update the main get started guide
tomek-labuk bb5522d
Update Get started with MCP server guide
tomek-labuk b9d4c90
Delete MCP guide
tomek-labuk 87270a3
Apply suggestions from code review
tomek-labuk e43d139
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk bf4ad81
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk 0247506
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk 20e49f9
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk 9bcff50
Merge branch 'release/ai-gateway-2.0' into feat/ai-gw-2-0-get-started
tomek-labuk File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,3 +1,5 @@ | ||
| To clean up all {{site.ai_gateway}} resources created in this guide, run: | ||
|
|
||
| ```bash | ||
| curl -Ls https://get.konghq.com/quickstart/ai | bash -s -- -d | ||
| ``` |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,8 +1,34 @@ | ||
| {% assign summary='{{site.ai_gateway_name}} running' %} | ||
| {% assign summary='{{site.ai_gateway}} running' %} | ||
| {% capture details_content %} | ||
| Placeholder prereq | ||
|
|
||
| This is a {{site.konnect_short_name}} tutorial and requires a {{site.konnect_short_name}} personal access token. | ||
|
|
||
| 1. Create a new personal access token by opening the [{{site.konnect_short_name}} PAT page](https://cloud.konghq.com/global/account/tokens) and selecting **Generate Token**. | ||
|
|
||
| 1. Export your token to an environment variable: | ||
|
|
||
| ```bash | ||
| export KONNECT_TOKEN='YOUR_KONNECT_PAT' | ||
| ``` | ||
|
|
||
| 1. Run the {{site.ai_gateway}} [quickstart script](https://get.konghq.com/quickstart/ai) to automatically provision a control plane and data plane in {{site.konnect_product_name}}, and configure your environment: | ||
|
|
||
| ```bash | ||
| curl -Ls https://get.konghq.com/quickstart/ai | bash -s -- -k $KONNECT_TOKEN | ||
| ``` | ||
|
|
||
| This sets up a {{site.ai_gateway}} control plane named `ai-quickstart`, provisions a local data plane, and prints out the following environment variables export: | ||
|
|
||
| ```bash | ||
| curl -Ls https://get.konghq.com/quickstart/ai | bash -s -- -d | ||
| export AI_GATEWAY_ID=your-gateway-id | ||
| export DECK_KONNECT_TOKEN=$KONNECT_TOKEN | ||
|
tomek-labuk marked this conversation as resolved.
|
||
| export DECK_KONNECT_CONTROL_PLANE_NAME=quickstart | ||
| export KONNECT_CONTROL_PLANE_URL=https://us.api.konghq.com | ||
| export KONNECT_PROXY_URL='http://localhost:8000' | ||
| ``` | ||
|
|
||
| Copy and paste these into your terminal to configure your session. | ||
|
|
||
| {% endcapture %} | ||
|
|
||
| {% include how-tos/prereq_cleanup_item.html summary=summary details_content=details_content icon_url='/assets/icons/ai-gateway.svg' %} | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.