scholarly journals How Translation Alters Sentiment

2016 ◽  
Vol 55 ◽  
pp. 95-130 ◽  
Author(s):  
Saif M. Mohammad ◽  
Mohammad Salameh ◽  
Svetlana Kiritchenko
Keyword(s):  
Sentiment Analysis ◽  
System A ◽  
Sentiment Lexicon ◽  
English Translations ◽  
Dialectal Arabic ◽  
Arabic And English ◽  
Analysis System ◽  
Arabic Sentiment Analysis ◽  
Translation Systems ◽  
Language Text

Sentiment analysis research has predominantly been on English texts. Thus there exist many sentiment resources for English, but less so for other languages. Approaches to improve sentiment analysis in a resource-poor focus language include: (a) translate the focus language text into a resource-rich language such as English, and apply a powerful English sentiment analysis system on the text, and (b) translate resources such as sentiment labeled corpora and sentiment lexicons from English into the focus language, and use them as additional resources in the focus-language sentiment analysis system. In this paper we systematically examine both options. We use Arabic social media posts as stand-in for the focus language text. We show that sentiment analysis of English translations of Arabic texts produces competitive results, w.r.t. Arabic sentiment analysis. We show that Arabic sentiment analysis systems benefit from the use of automatically translated English sentiment lexicons. We also conduct manual annotation studies to examine why the sentiment of a translation is different from the sentiment of the source word or text. This is especially relevant for building better automatic translation systems. In the process, we create a state-of-the-art Arabic sentiment analysis system, a new dialectal Arabic sentiment lexicon, and the first Arabic-English parallel corpus that is independently annotated for sentiment by Arabic and English speakers.

scholarly journals Negation Handling in Machine Learning-Based Sentiment Classification for Colloquial Arabic

2020 ◽  
Vol 11 (4) ◽  
pp. 33-45
Author(s):  
Omar Alharbi
Keyword(s):  
Machine Learning ◽  
Sentiment Analysis ◽  
Positive Impact ◽  
Machine Learning Algorithms ◽  
Sentiment Classification ◽  
Linguistic Knowledge ◽  
Sentiment Lexicon ◽  
Colloquial Arabic ◽  
Arabic Sentiment Analysis ◽  
The Impact

One crucial aspect of sentiment analysis is negation handling, where the occurrence of negation can flip the sentiment of a review and negatively affects the machine learning-based sentiment classification. The role of negation in Arabic sentiment analysis has been explored only to a limited extent, especially for colloquial Arabic. In this paper, the authors address the negation problem in colloquial Arabic sentiment classification using the machine learning approach. To this end, they propose a simple rule-based algorithm for handling the problem that affects the performance of a machine learning classifier. The rules were crafted based on observing many cases of negation, simple linguistic knowledge, and sentiment lexicon. They also examine the impact of the proposed algorithm on the performance of different machine learning algorithms. Furthermore, they compare the performance of the classifiers when their algorithm is used against three baselines. The experimental results show that there is a positive impact on the classifiers when the proposed algorithm is used compared to the baselines.

scholarly journals AraCust: a Saudi Telecom Tweets corpus for sentiment analysis

2021 ◽  
Vol 7 ◽  
pp. e510
Author(s):  
Latifah Almuqren ◽  
Alexandra Cristea
Keyword(s):  
Sentiment Analysis ◽  
Language Processing ◽  
Exploratory Data Analysis ◽  
Simple Experiment ◽  
Gold Standard Corpus ◽  
Golden Standard ◽  
Exploratory Data ◽  
Dialectal Arabic ◽  
Arabic Sentiment Analysis ◽  
The Right

Comparing Arabic to other languages, Arabic lacks large corpora for Natural Language Processing (Assiri, Emam & Al-Dossari, 2018; Gamal et al., 2019). A number of scholars depended on translation from one language to another to construct their corpus (Rushdi-Saleh et al., 2011). This paper presents how we have constructed, cleaned, pre-processed, and annotated our 20,0000 Gold Standard Corpus (GSC) AraCust, the first Telecom GSC for Arabic Sentiment Analysis (ASA) for Dialectal Arabic (DA). AraCust contains Saudi dialect tweets, processed from a self-collected Arabic tweets dataset and has been annotated for sentiment analysis, i.e.,manually labelled (k=0.60). In addition, we have illustrated AraCust’s power, by performing an exploratory data analysis, to analyse the features that were sourced from the nature of our corpus, to assist with choosing the right ASA methods for it. To evaluate our Golden Standard corpus AraCust, we have first applied a simple experiment, using a supervised classifier, to offer benchmark outcomes for forthcoming works. In addition, we have applied the same supervised classifier on a publicly available Arabic dataset created from Twitter, ASTD (Nabil, Aly & Atiya, 2015). The result shows that our dataset AraCust outperforms the ASTD result with 91% accuracy and 89% F1avg score. The AraCust corpus will be released, together with code useful for its exploration, via GitHub as a part of this submission.

scholarly journals Sentiment Analysis of Short Informal Texts

2014 ◽  
Vol 50 ◽  
pp. 723-762 ◽  
Author(s):  
S. Kiritchenko ◽  
X. Zhu ◽  
S. M. Mohammad
Keyword(s):  
Sentiment Analysis ◽  
Text Classification ◽  
State Of The Art ◽  
Surface Form ◽  
Shared Task ◽  
High Coverage ◽  
Percentage Points ◽  
Sentiment Lexicon ◽  
Analysis System ◽  
Performance Gains

We describe a state-of-the-art sentiment analysis system that detects (a) the sentiment of short informal textual messages such as tweets and SMS (message-level task) and (b) the sentiment of a word or a phrase within a message (term-level task). The system is based on a supervised statistical text classification approach leveraging a variety of surface-form, semantic, and sentiment features. The sentiment features are primarily derived from novel high-coverage tweet-specific sentiment lexicons. These lexicons are automatically generated from tweets with sentiment-word hashtags and from tweets with emoticons. To adequately capture the sentiment of words in negated contexts, a separate sentiment lexicon is generated for negated words. The system ranked first in the SemEval-2013 shared task `Sentiment Analysis in Twitter' (Task 2), obtaining an F-score of 69.02 in the message-level task and 88.93 in the term-level task. Post-competition improvements boost the performance to an F-score of 70.45 (message-level task) and 89.50 (term-level task). The system also obtains state-of-the-art performance on two additional datasets: the SemEval-2013 SMS test set and a corpus of movie review excerpts. The ablation experiments demonstrate that the use of the automatically generated lexicons results in performance gains of up to 6.5 absolute percentage points.

Arabic senti-lexicon: Constructing publicly available language resources for Arabic sentiment analysis

2017 ◽  
Vol 44 (3) ◽  
pp. 345-362 ◽  
Author(s):  
Tareq Al-Moslmi ◽  
Mohammed Albared ◽  
Adel Al-Shabi ◽  
Nazlia Omar ◽  
Salwani Abdullah
Keyword(s):  
Sentiment Analysis ◽  
Critical Role ◽  
Machine Learning Algorithms ◽  
Support Vector ◽  
Language Resources ◽  
Feature Sets ◽  
Feature Vectors ◽  
Sentiment Lexicon ◽  
Wide Range ◽  
Arabic Sentiment Analysis

Sentiment analysis is held to be one of the highly dynamic recent research fields in Natural Language Processing, facilitated by the quickly growing volume of Web opinion data. Most of the approaches in this field are focused on English due to the lack of sentiment resources in other languages such as the Arabic language and its large variety of dialects. In most sentiment analysis applications, good sentiment resources play a critical role. Based on that, in this article, several publicly available sentiment analysis resources for Arabic are introduced. This article introduces the Arabic senti-lexicon, a list of 3880 positive and negative synsets annotated with their part of speech, polarity scores, dialects synsets and inflected forms. This article also presents a Multi-domain Arabic Sentiment Corpus (MASC) with a size of 8860 positive and negative reviews from different domains. In this article, an in-depth study has been conducted on five types of feature sets for exploiting effective features and investigating their effect on performance of Arabic sentiment analysis. The aim is to assess the quality of the developed language resources and to integrate different feature sets and classification algorithms to synthesise a more accurate sentiment analysis method. The Arabic senti-lexicon is used for generating feature vectors. Five well-known machine learning algorithms: naïve Bayes, k-nearest neighbours, support vector machines (SVMs), logistic linear regression and neural network are employed as base-classifiers for each of the feature sets. A wide range of comparative experiments on standard Arabic data sets were conducted, discussion is presented and conclusions are drawn. The experimental results show that the Arabic senti-lexicon is a very useful resource for Arabic sentiment analysis. Moreover, results show that classifiers which are trained on feature vectors derived from the corpus using the Arabic sentiment lexicon are more accurate than classifiers trained using the raw corpus.

Sign in / Sign up

Export Citation Format

Share Document