Gorilla LogoHome

GOTCHA: Human Evaluation

The following experiments were used to carry out for human evaluations of original recorded videos and deepfake videos derived from them. Three real-time deepfake generators were used to simulate how a human could evaluate a potential imposter in a live interaction, doing the prescribed challenges.

Back to Open Materials


The full experiment

Built with Experiment

Preview the whole experiment as it actually ran for participants, except the enforced waiting.

Lower parts are individual components used for this experiment.

Gorilla Open Materials Attribution-NonCommerical Research-Only


DF Consent

Built with Questionnaire Builder 2

Gorilla Open Materials Attribution-NonCommerical Research-Only


Instructions and Quiz

Built with Task Builder 2

Participants were familiarized with deepfake artifacts they might encounter and had to pass this quiz scoring atleast 6 out of 10.

We have removed the wait times wherever enforced.

Gorilla Open Materials Attribution-NonCommerical Research-Only


Main Task of Deepfake Video Evaluations

Built with Task Builder 2

Each video evaluation included 4 responses -- Compliance to a challenge, Realism of the video, Identification of the artifacts, and their Localization.

Gorilla Open Materials Attribution-NonCommerical Research-Only

Private

Restricted! Access by URL only

Published on 02 November 2023