COLIEE: Competition for Legal Information Extraction and Entailment
Juliano RABELO, Mi-Young KIM, Randy GOEBEL, Masaharu YOSHIOKA, Yoshinobu KANO et Ken SATOH, « COLIEE: Competition for Legal Information Extraction and Entailment », (2020) 35-3 Journal of Japanese Society of Artificial Intelligence 377.
This paper presents a summary of the 7th Competition on Legal Information Extraction and Entailment. The competition consists of four tasks on case law and statute law. The case law component in- cludes an information retrieval task (Task 1), and the confirmation of an entailment relation between an existing case and an unseen case (Task 2). The statute law component includes an information retrieval task (Task 3) and an entailment/question answering task (Task 4). Participa- tion was open to any group based on any approach. Ten different teams participated in the case law competition tasks, most of them in more than one task. We received results from 9 teams for Task 1 (22 runs) and 8 teams for Task 2 (22 runs). On the statute law task, there were 14 different teams participating, most in more than one task. Eleven teams submitted a total of 28 runs for Task 3, and 13 teams submitted a total of 30 runs for Task 4. We describe in this paper the approaches, our official evaluation, and analysis on our data and submission results.