A cheap way to compare LLM knowledge

I stumbled upon this by chance. I was trying to get subcategories for some categories. I prompted different LLMs to generate subcategories for these categories. Particularly, I asked for exhaustive lists of subcategories in json format. The number and kind of subcategories for each category given by each model gives a great insight into several things: how each model categorizes different topics…