24th September 2024

MentalRiskES

Early detection of mental disorders risk in Spanish

 Description

According to a recent report by the World Health Organization, there is 1 in every 8 people in the world suffering from a mental disorder. The COVID-19 pandemic has raised the prevalence of anxiety and depression to more than 26% in just one year. Suicide is the fourth leading cause of death among 15-29 year-olds. The organisation considers that early identification is a key effective intervention to prevent these problems.

Consequently, there is a growing interest in detecting and identifying mental disorders in social media streams. This answers a demand from society due to the high increase in these problems among the population, in several kinds of mental risks: eating disorders, dysthymia, anxiety, depression, suicidal ideation, and others. Actually, relevant evaluation campaigns like the Cross-Lingual Evaluation Forum (CLEF)  have hosted during the last years the Early-Risk Identification task (eRisk). Unfortunately, these campaigns have focused mainly on English, leaving aside other languages, like Spanish. 

This proposal describes the second edition of a novel task on early risk identification of mental disorders in Spanish comments from social media sources. The first edition took place last year in the IberLEF evaluation forum as part of the SEPLN 2023. The task was resolved as an online problem, that is, the participants had to detect a potential risk as early as possible in a continuous stream of data. Therefore, the performance not only depended on the accuracy of the systems but also on how fast the problem is detected. These dynamics are reflected in the design of the tasks and the metrics used to evaluate participants. For this second edition, we propose three novel tasks, the first subtask is about the detection of the disorder, the second subtask consists of detecting the context that may be associated with the disorder, and the third subtask is about suicidal ideation detection. 

If you want to participate in the MentalRiskEs@IberLEF2024 shared task, please fill this form. Once you are registered, you can ask any questions through the Google Group of the shared task MentalRiskEs@IberLEF2024.

Participants will be required to submit their runs and their submissions will be evaluated on the test partitions for the corresponding corpora. The task is designed as an online problem, so participants will be instructed on the usage of a submission API to get the next message in the history of the user and to submit a prediction for that user according to the timeline of messages retrieved so far. Again, a base notebook showing how to perform retrieval and submissions will be delivered to participants. A phase with trial data is foreseen to check systems before the evaluation period.

Participants will be required to submit their runs and are asked to describe their systems in paper submissions. We encourage participating teams to highlight the real contribution of their systems in identifying successful approaches along with failed attempts and findings on how to advance in more performant solutions. This description must contain the following details:

 Contact

If you have any specific question about the MentalRiskEs 2024 task, we may ask you to let us know through the Google Group MentalRiskEs@IberLEF2024.

For any other questions that do not directly concern the shared task, please contact with Arturo Montejo Ráez or Flor Miriam Plaza-del-Arco.

Arturo 

Montejo-Ráez

  University of Jaén 

amontejo@ujaen.es

Email

Flor Miriam 

Plaza-del-Arco 

 Bocconi University 

flor.plaza@unibocconi.it

Email

MentalRiskES at IberLEF2024

SINAI Research Group

Twitter: @NLP_SINAI

This work has been partially supported by Project CONSENSO (PID2021-122263OB-C21), Project MODERATES (TED2021-130145B-I00) and Project SocialTox (PDC2022-133146-C21) funded by MCIN/AEI/10.13039/501100011033