Bayesian Guardrails for AI Decisions: Measuring Uncertainty Before Automating Decisions

AI systems should not automate a decision simply because they can provide a prediction. A decision system should consider how uncertain the prediction is and defer if a mistake would be costly.