Skip to content

Support multiple targetPorts in InferencePool #4466

@sjberman

Description

@sjberman

As of today, NGF only supports a single targetPort in an InferencePool. With v1.2.1 of the Inference Extension, there is now a conformance test that verifies that an InferencePool can have multiple targetPorts and that traffic flows in parallel between them. NGF needs to support multiple ports.

Acceptance

  • Support multiple targetPorts in an InferencePool

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/inference-extensionRelated to the Gateway API Inference ExtensionenhancementNew feature or requestrefinedRequirements are refined and the issue is ready to be implemented.size/mediumEstimated to be completed within a week

    Type

    No type

    Projects

    Status

    🆕 New

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions