Why You Should Stop Using HotpotQA for AI Agents Evaluation in 2025

We published HotpotQA, a groundbreaking multi-step question answering dataset in 2018, which has since motivated and facilitated numerous AI agent research works. But you should probably reconsider using it for your AI agents research in 2025.