scholarly journals Overview of COLIEE 2017

10.29007/fm8f ◽  
2018 ◽  
Author(s):  
Yoshinobu Kano ◽  
Mi-Young Kim ◽  
Randy Goebel ◽  
Ken Satoh

We present the evaluation of the legal question answering Competition on Legal Information Extraction/Entailment (COLIEE) 2017. The COLIEE 2017 Task consists of two sub-Tasks: legal information retrieval (Task 1), and recognizing entailment between articles and queries (Task 2). Participation was open to any group based on any approach, and the tasks attracted 10 teams. We received 9 submissions to Task 1 (for a total of 17 runs), and 8 submissions to Task 2 (for a total of 20 runs).

10.29007/2xzw ◽  
2018 ◽  
Author(s):  
Danilo S. Carvalho ◽  
Vu Tran ◽  
Khanh Van Tran ◽  
Nguyen Le Minh

Legal professionals worldwide are currently trying to get up-to-pace with the explosive growth in legal document availability through digital means. This drives a need for high efficiency Legal Information Retrieval (IR) and Question Answering (QA) methods. The IR task in particular has a set of unique challenges that invite the use of semantic motivated NLP techniques. In this work, a two-stage method for Legal Information Retrieval is proposed, combining lexical statistics and distributional sentence representations in the context of Competition on Legal Information Extraction/Entailment (COLIEE). The combination is done with the use of disambiguation rules, applied over the rankings obtained through n-gram statistics. After the ranking is done, its results are evaluated for ambiguity, and disambiguation is done if a result is decided to be unreliable for a given query. Competition and experimental results indicate small gains in overall retrieval performance using the proposed approach. Additionally, an analysis of error and improvement cases is presented for a better understanding of the contributions.


10.29007/psgx ◽  
2018 ◽  
Author(s):  
Rohan Nanda ◽  
Adebayo Kolawole John ◽  
Luigi Di Caro ◽  
Guido Boella ◽  
Livio Robaldo

This paper presents a description about our adopted approach for the information retrieval and textual entailment tasks of the COLIEE 2017 competition. We address the information retrieval task by implementing a partial string matching and a topic clustering method. For the textual entailment task, we propose a Long Short-Term Memory (LSTM) - Convolutional Neural Network (CNN) model which utilizes word embeddings trained on the Google News vectors. We evaluated our approach for both tasks on the COLIEE 2017 dataset. The results demonstrate that the topic clustering method outperformed the partial string matching method in the information retrieval task. The performance of LSTM-CNN model was competitive with other textual entailment systems.


Algorithms ◽  
2017 ◽  
Vol 10 (1) ◽  
pp. 22 ◽  
Author(s):  
Marios Koniaris ◽  
Ioannis Anagnostopoulos ◽  
Yannis Vassiliou

2021 ◽  
Author(s):  
Truong-Thinh Tieu ◽  
Chieu-Nguyen Chau ◽  
Nguyen-Minh-Hoang Bui ◽  
Truong-Son Nguyen ◽  
Le-Minh Nguyen

Author(s):  
Lin Qiu ◽  
Hao Zhou ◽  
Yanru Qu ◽  
Weinan Zhang ◽  
Suoheng Li ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document