The Fact-based Event-centric Human-value Understanding (FEHU) task aims to evaluate language models’ ability to identify and preserve human values in factual news articles. It includes two core subtasks.
Task 1, Human Value Classification, involves multi-label classification of human values expressed across entire articles.
Task 2, Value-aware Text Generation, requires generating (subtask-2a) paraphrased or (subtask-2b) summarized versions of articles while ensuring that the original human value expressions are faithfully preserved.
All values are annotated using a structured taxonomy, including labels such as “equality,” “justice,” and “freedom of thought.”
FEHU offers a unique benchmark for evaluating language models’ value alignment and ethical sensitivity in both classification and generation tasks.