scholarly journals Efficient English Translation Method and Analysis Based on the Hybrid Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Chuncheng Wang
Keyword(s):  
Neural Network ◽  
English Translation ◽  
Short Term Memory ◽  
Chinese Translation ◽  
Long Distance ◽  
Hybrid Neural Network ◽  
Distance Information ◽  
Neural Machine Translation ◽  
Machine Learning Model ◽  
Translation Accuracy

Neural machine translation has been widely concerned in recent years. The traditional sequential neural network framework of English translation has obvious disadvantages because of its poor ability to capture long-distance information, and the current improved framework, such as the recurrent neural network, still cannot solve this problem very well. In this paper, we propose a hybrid neural network that combines the convolutional neural network (CNN) and long short-term memory (LSTM) and introduce the attention mechanism based on the encoder-decoder structure to improve the translation accuracy, especially for long sentences. In the experiment, this model is implemented based on TensorFlow, and the results show that the BLEU value of the proposed method is obviously improved compared with the traditional machine learning model, which proves the effectiveness of our method in English-Chinese translation.

scholarly journals Research on Intelligent English Translation Method Based on the Improved Attention Mechanism Model

2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Rong Wang
Keyword(s):  
Neural Network ◽  
English Translation ◽  
Attention Mechanism ◽  
Machine Learning Algorithms ◽  
Translation System ◽  
Test Results ◽  
Long Distance ◽  
Distance Information ◽  
Mechanism Model ◽  
Translation Accuracy

The use of neural machine algorithms for English translation is a hot topic in the current research. English translation using the traditional sequential neural framework, which is too poor at capturing long-distance information, has its own major limitations. However, the current improved frameworks, such as recurrent neural network translation, are not satisfactory either. In this paper, we establish an attention coding and decoding model to address the shortcomings of traditional machine translation algorithms, combine the attention mechanism with a neural network framework, and implement the whole English translation system based on TensorFlow, thus improving the translation accuracy. The experimental test results show that the BLUE values of the algorithm model built in this paper are improved to different degrees compared with the traditional machine learning algorithms, which proves that the performance of the proposed algorithm model is significantly improved compared with the traditional model.

scholarly journals PV Power Prediction, Using CNN-LSTM Hybrid Neural Network Model. Case of Study: Temixco-Morelos, México

Energies ◽  
2020 ◽  
Vol 13 (24) ◽  
pp. 6512
Author(s):  
Mario Tovar ◽  
Miguel Robles ◽  
Felipe Rashid
Keyword(s):  
Neural Network ◽  
Hybrid Model ◽  
Network Model ◽  
Neural Network Model ◽  
Short Term Memory ◽  
Lasso Regression ◽  
Neural Network Models ◽  
Model Case ◽  
Hybrid Neural Network ◽  
Photovoltaic Power

Due to the intermittent nature of solar energy, accurate photovoltaic power predictions are very important for energy integration into existing energy systems. The evolution of deep learning has also opened the possibility to apply neural network models to predict time series, achieving excellent results. In this paper, a five layer CNN-LSTM model is proposed for photovoltaic power predictions using real data from a location in Temixco, Morelos in Mexico. In the proposed hybrid model, the convolutional layer acts like a filter, extracting local features of the data; then the temporal features are extracted by the long short-term memory network. Finally, the performance of the hybrid model with five layers is compared with a single model (a single LSTM), a CNN-LSTM hybrid model with two layers and two well known popular benchmarks. The results also shows that the hybrid neural network model has better prediction effect than the two layer hybrid model, the single prediction model, the Lasso regression or the Ridge regression.

scholarly journals Application of Feature Extraction Algorithm in the Construction of Interactive English Chinese Translation Mode

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Guangjun Dong ◽  
Youchao Yang ◽  
Qiankun Zhang
Keyword(s):  
Feature Extraction ◽  
English Translation ◽  
Selection Process ◽  
Translation System ◽  
Chinese Translation ◽  
Feature Extraction Algorithm ◽  
Extraction Algorithm ◽  
Optimal Feature Selection ◽  
Translation Accuracy ◽  
Optimal Feature

In the process of English translation, traditional interactive English translation system is not obvious in English semantic context. The optimal feature selection process does not achieve the optimal translation solution, and the translation accuracy is low. Based on this, this paper designs an interactive English Chinese translation system based on a feature extraction algorithm. By introducing the feature extraction algorithm, the optimal translation solution is selected, and the semantic mapping model is constructed to translate the best translation into English Chinese translation. The real experiment results show that the interactive English Chinese translation system based on feature extraction algorithm can get the best solution.

scholarly journals Predicting Sentiment Polarity of Microblogs using an LSTM – CNN Deep Learning Model

2019 ◽  
Vol 8 (6) ◽  
pp. 4368-4373
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Prediction Accuracy ◽  
Short Term Memory ◽  
Learning Model ◽  
Supervised Machine Learning ◽  
Machine Learning Model ◽  
Proposed Model ◽  
Network Approaches

In this paper we propose a novel supervised machine learning model to predict the polarity of sentiments expressed in microblogs. The proposed model has a stacked neural network structure consisting of Long Short Term Memory (LSTM) and Convolutional Neural Network (CNN) layers. In order to capture the long-term dependencies of sentiments in the text ordering of a microblog, the proposed model employs an LSTM layer. The encodings produced by the LSTM layer are then fed to a CNN layer, which generates localized patterns of higher accuracy. These patterns are capable of capturing both local and global long-term dependences in the text of the microblogs. It was observed that the proposed model performs better and gives improved prediction accuracy when compared to semantic, machine learning and deep neural network approaches such as SVM, CNN, LSTM, CNN-LSTM, etc. This paper utilizes the benchmark Stanford Large Movie Review dataset to show the significance of the new approach. The prediction accuracy of the proposed approach is comparable to other state-of-art approaches.

scholarly journals Open Relation Extraction in Patent Claims with a Hybrid Network

2021 ◽  
Vol 2021 ◽  
pp. 1-7
Author(s):  
Boting Geng
Keyword(s):  
Neural Network ◽  
Natural Language ◽  
Language Processing ◽  
Network Architecture ◽  
Complex Structure ◽  
Relation Extraction ◽  
Attention Mechanism ◽  
Hybrid Network ◽  
Long Distance ◽  
Hybrid Neural Network

Research on relation extraction from patent documents, a high-priority topic of natural language process in recent years, is of great significance to a series of patent downstream applications, such as patent content mining, patent retrieval, and patent knowledge base constructions. Due to lengthy sentences, crossdomain technical terms, and complex structure of patent claims, it is extremely difficult to extract open triples with traditional methods of Natural Language Processing (NLP) parsers. In this paper, we propose an Open Relation Extraction (ORE) approach with transforming relation extraction problem into sequence labeling problem in patent claims, which extract none predefined relationship triples from patent claims with a hybrid neural network architecture based on multihead attention mechanism. The hybrid neural network framework combined with Bi-LSTM and CNN is proposed to extract argument phrase features and relation phrase features simultaneously. The Bi-LSTM network gains long distance dependency features, and the CNN obtains local content feature; then, multihead attention mechanism is applied to get potential dependency relationship for time series of RNN model; the result of neural network proposed above applied to our constructed open patent relation dataset shows that our method outperforms both traditional classification algorithms of machine learning and the-state-of-art neural network classification models in the measures of Precision, Recall, and F1.

scholarly journals Depressed People Detection from Bangla Social Media Status using LSTM and CNN Approach

2021 ◽  
Vol 2 (01) ◽  
pp. 41-47
Author(s):  
Tabassum Ferdous Mumu ◽  
Ishrat Jahan Munni ◽  
Amit Kumar Das
Keyword(s):  
Neural Network ◽  
Social Media ◽  
Short Term Memory ◽  
Support Vector ◽  
People Detection ◽  
Machine Model ◽  
Hybrid Neural Network ◽  
Suicidal Death ◽  
Long Short Term Memory ◽  
The Given

At present, depression is the main reason for suicidal death. Depression also causes different kinds of diseases. Nowadays, people are deeply involved in social media and like to share their feelings on social media. So, it becomes easy to analyze depression through social media. In this paper, a combination of two CNN (Convolutional Neural Network) and LSTM (Long Short-Term Memory) models has been proposed to make a hybrid CNN-LSTM model, CNN has performed for the image to create a matrix, and LSTM has given the result from the given matrix. In this paper, datasets are prepared based on depression and non-depression-related status. The proposed method has been applied to that dataset. The best result has been obtained using a hybrid neural network with the word embedding technique using the Bengali Facebook status dataset. We have used the SVM (Support Vector Machine) model to predict a small dataset of Bengali Facebook status and count vectorizer to count the word in the document. Finally, this paper has built up a model that makes strength and support for deep learning architecture.

Neural Machine Translation Using Sequence Modeling

2021 ◽  
Vol 9 (8) ◽  
pp. 2153-2169
Author(s):  
N Revathi
Keyword(s):  
Neural Network ◽  
Machine Translation ◽  
Language Processing ◽  
Recurrent Neural Network ◽  
Deep Neural Network ◽  
Short Term Memory ◽  
Short Term ◽  
Neural Machine Translation ◽  
Term Memory ◽  
Sequence Modeling

Abstract: Language is a main mode of communication, and translation is a critical tool for understanding information in a foreign language. Without the help of human translators, machine translation allows users to absorb unfamiliar linguistic material. The main goal of this project is to create a practical language translation from English to Hindi. Given its relevance and potential in the English-Hindi translation, machine translation is an efficient way to turn content into a new language without employing people. Among all available translation machines, Neural Machine Translation (NMT) is one of the most efficient ways. So, in this case, we're employing Sequence to Sequence Modeling, which includes the Recurrent Neural Network (RNN), Long and Short Term Memory (LSTM), and Encoder-Decoder methods. Deep Neural Network (DNN) comprehension and principles of deep learning, i.e. machine translation, are disclosed in the field of Natural Language Processing (NLP). In machine reclining techniques, DNN plays a crucial role. Keywords: Sequence to Sequence, Encoder-Decoder, Recurrent Neural Network, Long & Short term Memory, Deep Neural Network.

scholarly journals Continuous and automatic mortality risk prediction using vital signs in the intensive care unit: a hybrid neural network approach

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Stephanie Baker ◽  
Wei Xiang ◽  
Ian Atkinson
Keyword(s):  
Neural Network ◽  
Intensive Care ◽  
Risk Prediction ◽  
Mortality Risk ◽  
Short Term Memory ◽  
Healthcare Providers ◽  
Vital Signs ◽  
Mortality Prediction ◽  
Neural Network Approach ◽  
Hybrid Neural Network

AbstractMortality risk prediction can greatly improve the utilization of resources in intensive care units (ICUs). Existing schemes in ICUs today require laborious manual input of many complex parameters. In this work, we present a scheme that uses variations in vital signs over a 24-h period to make mortality risk assessments for 3-day, 7-day, and 14-day windows. We develop a hybrid neural network model that combines convolutional (CNN) layers with bidirectional long short-term memory (BiLSTM) to predict mortality from statistics describing the variation of heart rate, blood pressure, respiratory rate, blood oxygen levels, and temperature. Our scheme performs strongly compared to state-of-the-art schemes in the literature for mortality prediction, with our highest-performing model achieving an area under the receiver-operator curve of 0.884. We conclude that the use of a hybrid CNN-BiLSTM network is highly effective in determining mortality risk for the 3, 7, and 14 day windows from vital signs. As vital signs are routinely recorded, in many cases automatically, our scheme could be implemented such that highly accurate mortality risk could be predicted continuously and automatically, reducing the burden on healthcare providers and improving patient outcomes.

Gated Hierarchical LSTMs for Target-Based Sentiment Analysis

2018 ◽  
Vol 28 (11n12) ◽  
pp. 1719-1737
Author(s):  
Hao Wang ◽  
Xiaofang Zhang ◽  
Bin Liang ◽  
Qian Zhou ◽  
Baowen Xu
Keyword(s):  
Neural Network ◽  
Sentiment Analysis ◽  
Short Term Memory ◽  
Network Models ◽  
Neural Model ◽  
Attention Mechanism ◽  
Support Vector ◽  
Neural Network Models ◽  
Long Distance ◽  
Sentence Level

In the field of target-based sentiment analysis, the deep neural model combining attention mechanism is a remarkable success. In current research, it is commonly seen that attention mechanism is combined with Long Short-Term Memory (LSTM) networks. However, such neural network-based architectures generally rely on complex computation and only focus on single target. In this paper, we propose a gated hierarchical LSTM (GH-LSTMs) model which combines regional LSTM and sentence-level LSTM via a gated operation for the task of target-based sentiment analysis. This approach can distinguish different polarities of sentiment of different targets in the same sentence through a regional LSTM. Furthermore, it is able to concentrate on the long-distance dependency of target in the whole sentence via a sentence-level LSTM. The final results of our experiments on multi-domain datasets of two languages from SemEval 2016 indicate that our approach yields better performance than Support Vector Machine (SVM) and several typical neural network models. A case study of some typical examples also makes a supplement to this conclusion.

Sign in / Sign up

Export Citation Format

Share Document