Stochastic Refusal in RAG: Same Evidence, Different Answer

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Same question, same branch, same retrieval, same 10 evidence chunks with identical rerank scores - and one deployment refused while another answered with full clinical detail. The root cause wasn't retrieval. It was the LLM making a borderline judgment call on evidence that covered half the question well and the other half barely at all.

Read on duncanleung.com ↗