Abstract

Affective computing has been largely limited in terms of available data resources. The need to collect and annotate diverse in-the-wild datasets has become apparent with the rise of deep learning models, as the default approach to address any computer vision task. Some in-the-wild databases have been proposed. However: i) their size is small, ii) they are not audiovisual, iii) only a small part is manually annotated, iv) they contain a small number of subjects, or v) they are not annotated for all main behavior tasks (valence-arousal estimation, action unit detection and expression classification). To address these, we create the large-scale Aff-Wild2 database, which is the only in-the-wild database containing annotations for all 3 main behavior tasks. It is also the first audiovisual database with annotations for AUs. The Aff-Wild2 is annotated in a per frame basis for the seven basic expressions (i.e., happiness, surprise, anger, disgust, fear, sadness and the neutral state) and a category 'other' (denoting affective states not displayed within the seven basic expression), twelve action units (AUs 1, 2, 4, 6, 7,10,12,15, 23, 24, 25, 26) and valence and arousal. In total Aff-Wild2 consists of 594 videos of around 3M frames. Aff-Wild2 displays a big diversity in terms of subjects' ages, ethnicities and nationalities; it has also great variations and diversities of environments.

How to acquire the data

Important: The Aff-Wild2 EULAs have recently been updated. Please read the applicable EULA carefully in full before signing and submitting your request, with particular attention to the provisions shown in bold. Requests submitted using an outdated EULA or without following the stated requirements will be rejected and no response will be given. By signing the EULA, you confirm that you have read, understood and agreed to its terms.

Academics

If you are an academic holding a permanent, continuing, tenure-track or equivalent independent academic appointment at a university (e.g., Assistant Professor, Associate Professor or Full Professor), you must:

i)   complete and sign the Academic Research EULA;
ii)  use your official university e-mail address (the data cannot be released to personal e-mail addresses);
iii)  send an e-mail to d.kollias@qmul.ac.uk with the subject: Aff-Wild2 request by academic;
iv)  attach the signed EULA and include a brief explanation of why you require access to the Aff-Wild2 database and a link to your official university webpage.

Postdoctoral researchers and PhD students

Postdoctoral researchers and PhD students cannot apply as the Lead Researcher under the Academic Research EULA.
If you are a postdoctoral researcher or PhD student, your academic supervisor must apply using the Academic Research EULA following the procedure above and provide you with access as a Permitted Researcher.

Industry and research organisations

If you are from a company, commercial organisation, standalone research institute, research centre, laboratory, governmental body, or other non-university organisation and wish to acquire Aff-Wild2, please send an e-mail from your official organisational e-mail address to d.kollias@qmul.ac.uk with the subject: Aff-Wild2 request from industry/research organisation. Please explain:

i)   the organisation and research group/team requesting access;
ii)  why access to Aff-Wild2 is required; and
iii) whether the intended use is research-only or commercial.

Undergraduate and Master’s students

If you are an Undergraduate or Master’s student, you must:

i)    complete the Student Academic Research EULA;
ii)   print and sign the EULA in ink; a wet signature is required;
iii)  use your official university e-mail address (the data cannot be released to personal e-mail addresses);
iv)  send an e-mail to d.kollias@qmul.ac.uk with the subject: Aff-Wild2 request by student;
v)   attach the completed and wet-signed EULA and proof of your current student status (e.g., a valid student ID card or official university enrolment confirmation).

Important for Undergraduate and Master’s students: Aff-Wild2 cannot be provided under the Student EULA for an internship, placement, employment or other activity undertaken for or on behalf of a company, research institute or other non-university organisation. In such cases, the relevant organisation should apply under the procedure below.

Requests containing incomplete or incorrect information, including an incomplete EULA, an unsigned EULA, an EULA that has not been signed in ink, or the wrong EULA, will be rejected without further correspondence.

Processing Time:
Due to the high volume of requests, please allow about 14 days for the reply to your request for access.

Important Information

• All the images of the database are obtained from Youtube. We are not responsible for the content nor the meaning of these images.