Copbot Online: bias and variance in AI perceptions of risk

Just over a year ago, hot after the release of ChatGPT, I wrote Copbot to examine whether large language models could help articulate (or maybe even predict) police risk assessments for missing people. The conclusion? Eeeeh. Maybe. Ish. Like plenty of LLM use cases, they did a perfectly plausible job, but how comparable to human decision making they were was a whole different kettle of fish.…