videoturingtest.github.io - VTT: Toward Human level Video Story Understanding

Description: video turing test@ICCV19

Example domain paragraphs

@E4, COEX Convention Center, ICCV 2019 Half day (AM) on Nov 2, 2019, Seoul, Korea

The ability to craft and understand stories is a crucial cognitive tool used by humans for communication. According to computational linguists, narrative theorists and cognitive scientists, the story understanding is a good proxy to measure the readers' intelligence. Readers can understand a story as a way of problem-solving in which, for example, they keep focusing on how main characters overcome certain obstacles throughout the story. Readers need to make inferences both in prospect and in retrospect abou

Especially, the video story data such as TV shows and movies can serve as an excellent testbed to evaluate the human-level AI algorithms from two points of view. First, video data have different modalities such as a sequence of images, audios (including dialogue, sound effects and background music) and text (subtitles or added comments). Second, video data show various cross-sections of everyday life. Therefore, understanding video story can be thought of a significant challenge to current AI technology, wh

Links to videoturingtest.github.io (2)