Ask a model a stupid question …

TLDR; you can use a mature model with lots of detail and vetted data to produce garbage output by feeding it a dumb scenario and willfully misinterpreting the answers.