Kubernetes-Native Model Serving

Deploy containerized models onto Kubernetes clusters, manage scaling replicas, and handle service discovery.

Assumes: Containers & Kubernetes fundamentals.

Modules

1. Introduction to Kubernetes for Machine Learning
2. Deploying Model Inference Workloads via Pods and Deployments
3. Managing Services, Ingress, and Resource Limits

Tools

• Kubernetes
• kubectl
• Docker
• Linux