https://bookofdaniel.in/tags/kubernetes/ Recent content in Kubernetes on Daniel - Minimalist | Tinkerer | Believer Hugo en-us daniel.mudanjara@gmail.com (Dan) daniel.mudanjara@gmail.com (Dan) Sat, 12 Sep 2026 10:26:04 +0530 https://bookofdaniel.in/posts/why-kubernetes-is-bad-at-serving-llms/ Fri, 11 Sep 2026 22:50:27 +0530daniel.mudanjara@gmail.com (Dan) https://bookofdaniel.in/posts/why-kubernetes-is-bad-at-serving-llms/ <blockquote><p>Part 1 of my llm-d series. Writing this down as I learn it, so both of us understand it properly.</p> </blockquote> <hr> <p>You have seen it. You ask Claude or ChatGPT something, the answer starts streaming nicely, word by word&hellip; and then it freezes. Mid-sentence. Two seconds of nothing, then it continues like nothing happened.</p> <p>Ever wondered why that happens?</p> <p>By the end of this post, you will know exactly why. And you will also know why Kubernetes, the way we normally use it, cannot fix it.</p>