Oliver Buchannon
Anirudh Sharma

Building systems, breaking illusions, and sharing learnings.

LLM Token Economics Is Textbook Monopoly Behaviour

LLM Token Economics Is Textbook Monopoly Behaviour

Apply consumer theory to understand why LLM pricing works the way it does

Jul 6, 2026

The Saga Pattern: Distributed Transactions Without 2PC

The Saga Pattern: Distributed Transactions Without 2PC

Why two-phase commit fails in production, and how sagas use compensating transactions to build reliable cross-service workflows without distributed locking.

Jun 29, 2026

Observability for LLM Applications: Seeing Inside the Black Box

Observability for LLM Applications: Seeing Inside the Black Box

LLMs break traditional observability. Log tokens, trace multi-step chains, attribute costs, monitor quality with evals, and handle privacy deliberately.

Jun 22, 2026

Event Sourcing: When, Why, and How (and When Not To)

Event Sourcing: When, Why, and How (and When Not To)

Event sourcing is cool, until it isn't. Store events, not state but only when it makes sense.

Jun 15, 2026

Why Your Load Balancer is Solving a Market Design Problem

Why Your Load Balancer is Solving a Market Design Problem

Load balancing algorithms are resource allocation mechanisms in disguise.

Jun 8, 2026

Latency Optimization for LLM Applications

Latency Optimization for LLM Applications

Three seconds will still feel like forever to your users. Make sure they never have to wait that long staring at a spinner.

Jun 1, 2026

Distributed Locks: Patterns, Pitfalls, and the Redlock Controversy

Distributed Locks: Patterns, Pitfalls, and the Redlock Controversy

Locking across machines is harder than you think

May 25, 2026

The True Cost of LLM Applications

The True Cost of LLM Applications

Your LLM costs more than you think - here's the full picture

May 18, 2026

Backpressure: When The System Can't Keep Up

Backpressure: When The System Can't Keep Up

Fast producers + slow consumers = cascading failure

May 11, 2026

Building Reliable AI Agents

Building Reliable AI Agents

Unserstanding deeply what actually breaks in production

May 4, 2026

Database Replication Topologies

Database Replication Topologies

One copy isn’t enough. Here’s how databases stay synchronized.

Apr 27, 2026

Chunking Strategies for RAG: The Definitive Practical Guide

Chunking Strategies for RAG: The Definitive Practical Guide

RAG is the dominant AI application pattern. Chunking is the #1 pain point.

Apr 20, 2026

Circuit Breakers: Building Systems That Survive Downstream Failures

Circuit Breakers: Building Systems That Survive Downstream Failures

Your downstream service will fail. Not might - will. Learn how to tackle these partitions in production.

Apr 13, 2026

Consensus Algorithms: Raft Explained From First Principles

Consensus Algorithms: Raft Explained From First Principles

Distributed agreement is fundamentally hard. Here’s how Raft actually works

Apr 6, 2026

Structured Outputs: JSON, Tools, and Function Calling That Actually Work

Structured Outputs: JSON, Tools, and Function Calling That Actually Work

Getting reliable structured data from LLMs is harder than it looks

Mar 30, 2026

CAP Theorem: What It Actually Means (Not What You Think)

CAP Theorem: What It Actually Means (Not What You Think)

Everyone quotes CAP theorem, but no one really understands it.

Mar 23, 2026

Idempotency: Pattern That Makes Distributed Systems Actually Work

Idempotency: Pattern That Makes Distributed Systems Actually Work

“Just retry” only works if your operation is idempotent

Mar 16, 2026

Context Window Management: The Hidden Engineering Problem

Context Window Management: The Hidden Engineering Problem

128K tokens doesn’t mean you should use 128K tokens

Mar 9, 2026

Timeouts, Retries, and Deadlines

Timeouts, Retries, and Deadlines

Wrong timeout settings cause more outages than bugs

Mar 2, 2026

Don't Break Production With a Retry Loop

Don't Break Production With a Retry Loop

Your LLM application will hit rate limits. Here's how to handle it gracefully with exponential backoff, token buckets, and priority queuing.

Feb 23, 2026

5 Questions to Ask Before Adding a Vector DB

5 Questions to Ask Before Adding a Vector DB

Production decision-making checklist to understand if a vector database is really required

Feb 16, 2026

From 50,000 Dimensions to 384: Compression That Powers AI

From 50,000 Dimensions to 384: Compression That Powers AI

How models learn semantic relationships in language

Feb 9, 2026

The $0.002 That Decides If Your AI App Makes Money

The $0.002 That Decides If Your AI App Makes Money

The survival of your AI app depends on your token economics

Feb 2, 2026

Why Non-English Speakers Pay 2x More For LLMs

Why Non-English Speakers Pay 2x More For LLMs

The Invisible Tax of AI Tokenization: Why Non-English Speakers Pay More

Jan 26, 2026

What Happens in the 200ms After You Hit Enter on Your LLM?

What Happens in the 200ms After You Hit Enter on Your LLM?

How your prompt becomes vectors, attention, and text in milliseconds

Jan 19, 2026

Load more

XGitHubRSS
© 2026 The Main Thread.
beehiivPowered by beehiiv