Featured
5 Reasons Your RAG System Fails in Production
RAG demos take an afternoon. Production takes months. Here are the 5 boring mistakes like bad chunking and context overflow that actually break RAG in the wild.
Blog
Notes on software, design, and systems.
Featured
Under the Hood of Vector Databases
A deep dive into embeddings, approximate nearest neighbors, and the architecture of similarity search, covering algorithms like HNSW, IVF, ANN, etc.
Featured
Designing RAG architecture for 10 million documents
Building RAG for 1,000 docs is a weekend project. At 10 million, it's a whole different story. In this article we break down everything to help you design one.
Featured
How Transformers Actually Work: One Sentence, Start to Finish
A step-by-step walkthrough of transformer architecture that follows one sentence from raw text to a translated output — with the attention math worked out by hand, not hand-waved.
Featured
AI Agent Harness & Loop Engineering
WTF is an Agent Harness or Loop Engineering? Stop drowning in AI buzzwords. Here's a no-BS breakdown of how AI agents actually use memory and execute tasks.
Featured
How AI Agent Memory Actually Works: RAG, Semantic and Episodic Memory, Vector Database
Your AI assistant remembers your job, your codebase, you project, without you repeating a thing. Here's the actual system behind that: procedural, semantic, and episodic memory.
Featured
System Design for ChatGPT
A deep dive into ChatGPT's system design. Learn to serve 225M DAU, stream sub-500ms responses, optimize expensive GPUs, and efficiently manage context at scale.
Featured
Understanding Services & Ingress in Kubernetes
Services make Pods reachable; Ingress routes external traffic to the right Service. Learn ClusterIP, NodePort, LoadBalancer, and Ingress (controller vs resource).
Featured
How Leetcode handles millions of code submissions.
How does LeetCode securely handle millions of code submissions? Dive into the system design, exploring Docker containers, worker queues, caching, and vital security constraints.
Featured
How Payment Gateways Keep Your Money (and Data) Safe
Payment gateways are the invisible middlemen behind online purchases. Building them is complex, and this article dives into one crucial aspect of their design: security.
Rate Limiting 101. How I'd Design a Rate Limiter — A System Design Breakdown
If you've ever wondered how apps like Twitter, GitHub, ChatGPT or Claude stop you from hammering their APIs with thousands of requests, here's the answer.