VTt PROSPECTIVE EVENTS
VTT Prospective Event
VTT Prospective Event
The development of a system capable of successfully passing the VTT could also inspire different forms of promotion. An event like this could be of the following contest style based on a popular Korean TV Show.
Hold an "Beyond the Turing Test" event to ensure that the system has video understanding capabilities.
Beyond the Turing Test
Beyond the Turing Test
Participants of humans and machines watch a video together and have to answer questions while an audience of about 100 people, who don't know whom of the participants is human or a machine, has to evaluate the participant's answers to find out who is actually a human and who is not (Turing Test similarities). This could be a broadcasted event through various forms of media.
Method
Method
- Event Place: A hall that can accommodate all of the participants, evaluators/audience and the event staff. Such a hall could for example be the MBC Open Hall.
- Audience Selection: One hundred randomly selected from the general pulic after applying online. Considerations of various age groups, educational backgrounds and gender should be taken to ensure a variety of evaluators.
- Participants: AI Systems and three human control group participants of people in their 20s to 30s. Measures are needed to keep the identity of all 6 participants hidden from the audience.
Procedure
Procedure
- Video content selection and watch time (18 min)
- One-on-one conversation between the moderator and the participants (30 min)
- Audience votes (5 min)
- Voting results revelation and participant's identity disclosure (5 min)