Why We Still Need GPU Partitioning
Bigger models make GPU partitioning matter more.
Inference
KAITO and KubeFleet: CNCF Is Reshaping AI Inference Infrastructure
CNCF is standardizing AI inference infrastructure for scalable deployment in multi-cluster Kubernetes environments through KAITO and KubeFleet.
Building Efficient LLM Inference with the Cloud Native Quartet: KServe, vLLM, llm-d, and WG Serving
Essential reading for cloud native and AI-native architects: how KServe, vLLM, llm-d, and WG Serving form the cloud native ‘quartet’ for large model inference, their …
The Natural Fit Between AI Inference and Kubernetes
Explore why Kubernetes is the ideal runtime for AI inference — delivering elastic, cost-efficient, low-latency model serving with GPU-aware autoscaling, versioning, and …