Battery-Included AI Platform: From Zero to Production LLMs with EKS, KRO, and GitOps

Building production-ready AI platforms on Kubernetes demands expertise spanning GPU orchestration, model serving, and cloud infrastructure—a barrier for many organizations. This session presents an opinionated, GitOps-driven architecture combining EKS, ArgoCD, KRO, and ACK to deploy complete AI stacks through simple custom resources.
Attendees will learn how to design platform abstractions using KRO, automate GPU provisioning with Karpenter, and integrate vLLM, LiteLLM, OpenWebUI, and Langfuse into a cohesive platform.
Includes live demo: Deploying multiple production LLMs with observability and chat interfaces in minutes.