Named Entity Recognition with Word Embeddings and Wikipedia Categories for a Low-Resource Language

2017 ◽  
Vol 16 (3) ◽  
pp. 1-19 ◽  
Author(s):  
Arjun Das ◽  
Debasis Ganguly ◽  
Utpal Garain
Keyword(s):  
Named Entity Recognition ◽  
Entity Recognition ◽  
Word Embeddings ◽  
Low Resource ◽  
Named Entity

scholarly journals Named Entity Recognition for a Low Resource Language

2019 ◽  
Vol 8 (3) ◽  
pp. 587-590
Keyword(s):  
Machine Learning ◽  
Named Entity Recognition ◽  
Training Data ◽  
Entity Recognition ◽  
Linguistic Knowledge ◽  
Rule Based ◽  
Low Resource ◽  
Named Entity ◽  
The North ◽  
Rule Based Approach

Kokborok named entity recognition using the rules based approach is being studied in this paper. Named entity recognition is one of the applications of natural language processing. It is considered a subtask for information extraction. Named entity recognition is the means of identifying the named entity for some specific task. We have studied the named entity recognition system for the Kokborok language. Kokborok is the official language of the state of Tripura situated in the north eastern part of India. It is also widely spoken in other part of the north eastern state of India and adjoining areas of Bangladesh. The named entities are like the name of person, organization, location etc. Named entity recognitions are studied using the machine learning approach, rule based approach or the hybrid approach combining the machine learning and rule based approaches. Rule based named entity recognitions are influence by the linguistic knowledge of the language. Machine learning approach requires a large number of training data. Kokborok being a low resource language has very limited number of training data. The rule based approach requires linguistic rules and the results are not depended on the size of data available. We have framed a heuristic rules for identifying the named entity based on linguistic knowledge of the language. An encouraging result is obtained after we test our data with the rule based approach. We also tried to study and frame the rules for the counting system in Kokborok in this paper. The rule based approach to named entity recognition is found suitable for low resource language with limited digital work and absence of named entity tagged data. We have framed a suitable algorithm using the rules for solving the named entity recognition task for obtaining a desirable result.

Sign in / Sign up

Export Citation Format

Share Document