Automatic Chinese Keyword Extraction Based on KNN for Implicit Subject Extraction

2008 ◽  
Author(s):  
Zhang Qingguo ◽  
Zhang Chengzhi
Keyword(s):  
Keyword Extraction ◽  
Subject Extraction

scholarly journals Keyword extraction method for machine reading comprehension based on natural language processing

2021 ◽  
Vol 1955 (1) ◽  
pp. 012072
Author(s):  
Ruiheng Li ◽  
Xuan Zhang ◽  
Chengdong Li ◽  
Zhongju Zheng ◽  
Zihang Zhou ◽  
...  
Keyword(s):  
Reading Comprehension ◽  
Natural Language Processing ◽  
Natural Language ◽  
Language Processing ◽  
Extraction Method ◽  
Keyword Extraction ◽  
Machine Reading

scholarly journals Offensive keyword extraction based on the attention mechanism of BERT and the eigenvector centrality using a graph representation

2021 ◽  
Author(s):  
Gretel Liz De la Peña Sarracén ◽  
Paolo Rosso
Keyword(s):  
Language Model ◽  
Hybrid Approach ◽  
Attention Mechanism ◽  
Graph Representation ◽  
Keyword Extraction ◽  
Eigenvector Centrality ◽  
Model Learning ◽  
Harmful Content ◽  
The Impact ◽  
Offensive Language

AbstractThe proliferation of harmful content on social media affects a large part of the user community. Therefore, several approaches have emerged to control this phenomenon automatically. However, this is still a quite challenging task. In this paper, we explore the offensive language as a particular case of harmful content and focus our study in the analysis of keywords in available datasets composed of offensive tweets. Thus, we aim to identify relevant words in those datasets and analyze how they can affect model learning. For keyword extraction, we propose an unsupervised hybrid approach which combines the multi-head self-attention of BERT and a reasoning on a word graph. The attention mechanism allows to capture relationships among words in a context, while a language model is learned. Then, the relationships are used to generate a graph from what we identify the most relevant words by using the eigenvector centrality. Experiments were performed by means of two mechanisms. On the one hand, we used an information retrieval system to evaluate the impact of the keywords in recovering offensive tweets from a dataset. On the other hand, we evaluated a keyword-based model for offensive language detection. Results highlight some points to consider when training models with available datasets.

Sign in / Sign up

Export Citation Format

Share Document