Tag

llm

3 cards

Cards

A prompted JSON response wrapped in markdown and a cheerful preamble against constrained decoding that enforces the shape while generating, and the business validation a well-formed response still needs

AI SystemsDay 62Oct 3, 2026

Stop Asking Nicely For JSON

system-design ai-systems llm

Four hundred identical refund-policy questions each billed in full, beside prompt caching at the model provider and semantic caching by embedding similarity, and the 0.92 match that returns the wrong answer

AI SystemsDay 39Sep 8, 2026

The Same Question, Paid For Twice

system-design ai-systems semantic-caching

A circuit-traced brain labelled AI, beside two identical-looking citations, one true and one fabricated

The "Hallucination" Problem Isn't A Bug — It's The Point

ai llm epistemics