-
Notifications
You must be signed in to change notification settings - Fork 154
Open
Labels
area/inference-extensionRelated to the Gateway API Inference ExtensionRelated to the Gateway API Inference ExtensionenhancementNew feature or requestNew feature or requestrefinedRequirements are refined and the issue is ready to be implemented.Requirements are refined and the issue is ready to be implemented.size/mediumEstimated to be completed within a weekEstimated to be completed within a week
Milestone
Description
As of today, NGF only supports a single targetPort in an InferencePool. With v1.2.1 of the Inference Extension, there is now a conformance test that verifies that an InferencePool can have multiple targetPorts and that traffic flows in parallel between them. NGF needs to support multiple ports.
Acceptance
- Support multiple targetPorts in an InferencePool
Metadata
Metadata
Assignees
Labels
area/inference-extensionRelated to the Gateway API Inference ExtensionRelated to the Gateway API Inference ExtensionenhancementNew feature or requestNew feature or requestrefinedRequirements are refined and the issue is ready to be implemented.Requirements are refined and the issue is ready to be implemented.size/mediumEstimated to be completed within a weekEstimated to be completed within a week
Type
Projects
Status
🆕 New