LvBench is a Long-form Video understanding Benchmark for versatile multi-modal question-answering. It stands out from existing long-form VideoQA datasets through three key characteristics: 1) Extended temporal durations: we consider videos ranging from 70 seconds to 4 hours, covering single-scene, multi-scene, and full-scene contexts—this design accounts for both video and clue lengths, capturing diverse contextual dynamics; 2) Diverse question types and modalities: LvBench introduces six distinct question types that evaluate various perceptual and cognitive capabilities, utilizing both video frames and subtitles; 3) High-quality annotations: we employ rigorous manual labeling by human annotators.

Data Preparation

1. The QA and videos can be downloaded from Lvbench.

Evaluation with Qwen2.5-VL

bash test_code_qwenvl25/eval.sh