Event Causality Identification with Causal News Corpus - Shared Task 3, CASE 2022

Tan, Fiona Anting and Hettiarachchi, Hansi and Hürriyeto˘glu, Ali and Caselli, Tommaso and Uca, Onur and Liza, Farhana Ferdousi and Oostdijk, Nelleke (2022) Event Causality Identification with Causal News Corpus - Shared Task 3, CASE 2022. In: The 2022 Conference on Empirical Methods in Natural Language Processing, 7th - 8th December 2022, Abu Dhabi, United Arab Emirates (Hybrid).

2022.case-1.28.pdf - Published Version
Available under License Creative Commons Attribution.

Download (591kB)


The Event Causality Identification Shared Task of CASE 2022 involved two subtasks working on the Causal News Corpus. Subtask 1 required participants to predict if a sentence contains a causal relation or not. This is a supervised binary classification task. Subtask 2 required participants to identify the Cause, Effect and Signal spans per causal sentence. This could be seen as a supervised sequence labeling task. For both subtasks, participants uploaded their predictions for a held-out test set, and ranking was done based on binary F1 and macro F1 scores for Subtask 1 and 2, respectively. This paper summarizes the work of the 17 teams that submitted their results to our competition and 12 system description papers that were received. The best F1 scores achieved for Subtask 1 and 2 were 86.19% and 54.15%, respectively. All the top-performing approaches involved pre-trained language models fine-tuned to the targeted task. We further discuss these approaches and analyze errors across participants’ systems in this paper.

Item Type: Conference or Workshop Item (Paper)
9 October 2022Accepted
31 December 2022Published Online
Subjects: CAH11 - computing > CAH11-01 - computing > CAH11-01-01 - computer science
Divisions: Faculty of Computing, Engineering and the Built Environment > School of Computing and Digital Technology
Depositing User: Hansi Hettiarachchi
Date Deposited: 15 May 2023 14:01
Last Modified: 15 May 2023 14:01
URI: https://www.open-access.bcu.ac.uk/id/eprint/14387

Actions (login required)

View Item View Item


In this section...