From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
From GPU hardware, Kubernetes scheduling, inference engines to token cost — understanding the 8-layer observability architecture for modern AI infrastructure.
In-depth articles and insights on open source, AI, cloud-native, DevOps, and software engineering.
From GPU to Token: The 8-Layer Observability Stack for AI Infrastructure
From GPU hardware, Kubernetes scheduling, inference engines to token cost — understanding the 8-layer observability architecture for modern AI infrastructure.
How I built a personal AI infrastructure using ChatGPT, OpenClaw, Obsidian, GitHub, Lark, GLM-5.1, and a Mac mini M4.
Token Is More Than a Billing Unit, It's Becoming the Resource Unit of the AI Era
The Linux Foundation’s Tokenomics Foundation signals a shift: tokens are becoming a core resource in the AI era, much like CPUs in the cloud era.
AI Native Landscape Launches as a Standalone Site
AI Native Landscape has moved to landscape.jimmysong.io with 600+ curated open-source projects, AI skill search support, and a call for community contributions.
Kubernetes as the GPU Control Plane for AI
Observations on the evolution of AI infrastructure control planes, focusing on HAMi v2.9, GPU scheduling, and Kubernetes resource models.
Kubernetes's Anxiety and Rebirth in the AI Wave
At KubeCon EU 2026, I witnessed Kubernetes’ anxiety and transformation in the AI era. This article explores the challenges and future opportunities for Kubernetes in the age of AI.
KubeCon EU 2026 Day One Observations
KubeCon Europe 2026 Day One: How Kubernetes is adapting to the AI infrastructure wave and the evolution of the GPU resource layer.
HAMi Website Redesign Overview
A systematic upgrade to HAMi’s website and docs, improving community visibility, content structure, search, and usability.
GTC 2026 Eve: AI is Becoming the New Infrastructure
On the eve of GTC 2026, rethinking whether AI is becoming the new infrastructure from NVIDIA’s AI Five-Layer Cake, the rise of agent runtime, to AI-native infrastructure.
When GPUs Move Toward Open Scheduling: Structural Shifts in AI Native Infrastructure
A CTO/VP view on open GPU scheduling: CDI, Kubernetes DRA, virtualization data planes, ecosystem governance, and lock-in risk.