VTt PROSPECTIVE EVENTS

VTT Prospective Event

The development of a system capable of successfully passing the VTT could also inspire different forms of promotion. An event like this could be of the following contest style based on a popular Korean TV Show.

Hold an "Beyond the Turing Test" event to ensure that the system has video understanding capabilities.

Beyond the Turing Test

Participants of humans and machines watch a video together and have to answer questions while an audience of about 100 people, who don't know whom of the participants is human or a machine, has to evaluate the participant's answers to find out who is actually a human and who is not (Turing Test similarities). This could be a broadcasted event through various forms of media.


Method

  1. Event Place: A hall that can accommodate all of the participants, evaluators/audience and the event staff. Such a hall could for example be the MBC Open Hall.
  2. Audience Selection: One hundred randomly selected from the general pulic after applying online. Considerations of various age groups, educational backgrounds and gender should be taken to ensure a variety of evaluators.
  3. Participants: AI Systems and three human control group participants of people in their 20s to 30s. Measures are needed to keep the identity of all 6 participants hidden from the audience.


Procedure

  1. Video content selection and watch time (18 min)
  2. One-on-one conversation between the moderator and the participants (30 min)
  3. Audience votes (5 min)
  4. Voting results revelation and participant's identity disclosure (5 min)