Tracked topic
In a Kubernetes context, an AI Gateway refers to network gateway infrastructure (including proxy servers, load-balancers, etc.) that generally implements the Gateway API specification with enhanced capabilities for AI workloads. Rather than defining a distinct product category, AI Gateways describe infrastructure designed to enforce policy on AI traffic, including: Token-based rate limiting for AI APIs.Fine-grained access controls for inference APIs.Payload inspection enabling intelligent routing, caching, and guardrails.Support for AI-specific protocols and routing patterns.
Announcing the AI Gateway Working Group… Apply the following manifest: --- apiVersion : v1 kind : Namespace metadata : name : gateway-infra --- apiVersion : gateway.networking.k8s.io/v1 kind : Gateway metadata : name : gateway namespace : gateway-infra spec : gatewayClassName : cloud-provider-kind listeners : - name : default hostname : "… …
… Both ListenerSets attach to the same Gateway and contribute additional HTTPS listeners. --- apiVersion : gateway.networking.k8s.io/v1 kind : Gateway metadata : name : example-gateway namespace : infra spec : gatewayClassName : example-gateway-class allowedListeners : namespaces : from : All A selec… …
… Related Kubernetes blog articles Gateway API v1.3.0: Advancements in Request Mirroring, CORS, Gateway Merging, and Retry Budgets June 2025 Gateway API v1.2: WebSockets, Timeouts, Retries, and More November 2024 Gateway API v1.1: Service mesh, GRPCRoute, and a whole lot more May 2024 New Experimenta…
… The commands from the previous section output a Gateway API manifest to gwapi.yaml , and they also emit warnings that explain what did not translate exactly and what to review manually. apiVersion : gateway.networking.k8s.io/v1 kind : Gateway metadata : annotations : gateway.networking.k8s.io/gener… …
… What is an AI Gateway? In a Kubernetes context, an AI Gateway refers to network gateway infrastructure including proxy servers, load-balancers, etc. that generally implements the Gateway API specification with enhanced capabilities for AI workloads. …
… Your backends might rely on the Ingress/Gateway API implementation to normalize URLs. That said, most Gateway API implementations will have some path normalization enabled by default. For example, Istio, Envoy Gateway, and Kgateway all normalize . and .. segments out of the box. …
… An example of how this could look is: apiVersion : gateway.networking.k8s.io/v1 kind : Gateway metadata : name : example-gateway spec : gatewayClassName : example-gateway-class addresses : - type : IPAddress value : "192.0.2.4" --- apiVersion : gateway.networking.k8s.io/v1 kind : HTTPRoute metadata… …
… Example: a namespaced on-call debug Role apiVersion : rbac.authorization.k8s.io/v1 kind : Role metadata : name : oncall-debug namespace : rules : Discover what’s running - apiGroups : "" resources : "pods" , "events" verbs : "get" , "list" , "watch" Read logs - apiGroups : "" resources : "pods/log"… …
… We cannot overstate the severity of this situation or the importance of beginning migration to alternatives like Gateway API or one of the many third-party Ingress controllers immediately. …
… Aditya Chaudhary improved Gateway API support, so you can see networking relationships on the resource map, as well as improved support for many of the new Gateway API resources. …