Pinned Loading

1. Kuadrant/mcp-gateway Kuadrant/mcp-gateway Public

   An envoy-based MCP Gateway that integrates with Istio and policy attachment mechanisms for authN, authZ, rate limiting and more.

   Go 58 44

2. llama-stack llama-stack Public

   Forked from llamastack/llama-stack

   Composable building blocks to build Llama Apps

   Python

3. kserve kserve Public

   Forked from kserve/kserve

   Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

   Go 1

4. gateway-api-inference-extension gateway-api-inference-extension Public

   Forked from kubernetes-sigs/gateway-api-inference-extension

   Gateway API Inference Extension

   Go

5. llm-d-inference-sim llm-d-inference-sim Public

   Forked from llm-d/llm-d-inference-sim

   A light weight vLLM simulator, for mocking out replicas.

   Go