Join PromiseEval

1. Register (Now - Jan 15, 2025)

To participate in PromiseEval, kindly register using this Registration Form: https://forms.gle/ZJFavqm5jeJLD6eW9

Participants may opt to join one, two, or all of the tasks. We welcome submissions with results derived from PromiseEval datasets.

2. Explore PromiseEval Tasks (Now - Jan 20, 2025)

You will get the datasets for all tasks within a few days after your registration. Participants are encouraged to explore the training data to create their models. The use of external data or resources is not only permitted but strongly recommended. This exploration can continue until the evaluation phase begins.

Baseline Paper: https://arxiv.org/abs/2411.04473v1

3. Testing Period (Jan 10 - Jan 20, 2025)

We will release the test set on January 10th, 2025. Details on the submission procedure will be sent to participants.

4. Evaluation Period (Jan 21 - Jan 31, 2025)

More details will be released later.

5. Prepare System Description Paper (Feb 1 - Feb 19, 2025)

Teams are encouraged to draft a system description paper detailing their submission system, an analysis of their outcomes, and any notable insights. Please submit this by February 19th, 2025. Details regarding the paper submission process will be shared in due course.

• Paper Format: https://acl-org.github.io/ACLPUB/formatting.html

• Submission Site: https://softconf.com/acl2025/semeval2025/

6. Review and Feedback (Mar 7 - Mar 18, 2025)

Participants will review each other's papers and may offer guidance on papers that require further refinement in their writing.

7. Prepare Camera Ready Version (Apr 1 - Apr 21, 2025)

Following the review phase, each team must revise their paper in accordance with the feedback received and submit the final, camera-ready version.

8. Meet and Discuss at PromiseEval@SemEval-2025

Looking forward to seeing you at PromiseEval@SemEval-2025