Speculative Decoding
Inference Engineering: Part 5/8: When Speculative Decoding Backfires
Can spending extra work on a draft reduce the number of slow generation steps?
Nov 2, 2026
