Amazon Web Services announced Amazon SageMaker HyperPod Inference Gateway on September 18, 2026, a Kubernetes-native, GPU-aware routing system for large language model inference that deploys as a ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Lily Mara explains how to avoid high-risk ...

AI gateways extend API gateway principles to govern model access, prompt inspection, and agent tool use at runtime.

Microsoft and AWS enable a direct network connection between their cloud environments. The preview is limited to 1 Gbit/s. Microsoft and AWS have sent a joint network connection between Azure and AWS ...