Read: From using AI to building AI systems , a defining note on what I’m exploring.

AI-native infrastructure & Agent Runtime engineering notes

I focus on production engineering for inference, RAG, and agent runtimes: runtime abstractions, resource models, and system governance.

Core Technology Domains

These are the threads I keep returning to: practical abstractions, system boundaries, and what it takes to ship reliably.

AI Native

AI Native

I explore inference, RAG, and agent collaboration from a runtime-first lens, aiming for abstractions that hold up in production.

Cloud Native

Cloud Native

I study how Kubernetes evolves under AI workloads: scheduling constraints, elasticity, observability, and multi-tenant governance.

Open Source

Open Source

I contribute to and learn from the AI infrastructure open-source ecosystem, with an engineer’s bias toward verifiable designs.

About Jimmy Song

I focus on AI-native infrastructure and agent runtimes, especially the engineering questions that show up in production: inference, RAG, platform engineering, and governance. I’m a CNCF Ambassador and Developer Advocate, and I also started ArkSphere (an engineering collective around AI-native infrastructure).

Jimmy Song's Avatar