Function Calling

Latency Optimization for LLM Applications

Latency Optimization for LLM Applications

Three seconds will still feel like forever to your users. Make sure they never have to wait that long staring at a spinner.

Jun 1, 2026

Structured Outputs: JSON, Tools, and Function Calling That Actually Work

Structured Outputs: JSON, Tools, and Function Calling That Actually Work

Getting reliable structured data from LLMs is harder than it looks

Mar 30, 2026

The Main Thread

AboutEssaysXGitHubRSS
© 2026 The Main Thread.
beehiivPowered by beehiiv