scholarly journals Unsupervised Wireless Network Model-Assisted Abnormal Warning Information in Government Management

2021 ◽  
Vol 2021 ◽  
pp. 1-12
Author(s):  
Yumeng Sun
Keyword(s):  
Factor Analysis ◽  
Network Model ◽  
Semantic Analysis ◽  
Technical Problem ◽  
Machine Learning Algorithms ◽  
Telecommunication Networks ◽  
Data Driven ◽  
Traffic Data ◽  
Nonlinear Simulation ◽  
Over The Top

The data generated through telecommunication networks has grown exponentially in the last few years, and the resulting traffic data is unlikely to be processed and analyzed by manual style, especially detecting unintended traffic consumption from normal patterns remains an important issue. This area is critical because anomalies may lead to a reduction in network efficiency. The origin of these anomalies may be a technical problem in a cell or a fraudulent intrusion in the network. Usually, they need to be identified and fixed as soon as possible. Therefore, in order to identify these anomalies, data-driven systems using machine learning algorithms are developed with the aim from the raw data to identify and alert the occurrence of anomalies. Unsupervised learning methods can spontaneously describe the data structure and derive network patterns, which is effective for identifying unintended anomalous behavior and detecting new types of anomalies in a timely manner. In this paper, we use different unsupervised models to analyze traffic data in wireless networks, focusing on models that analyze traffic data combined with timeline information. The factor analysis method is used to derive the results of factor analysis, obtain the three major public factors and comprehensive factor scores, and combine the results with the BP neural network model to conduct a nonlinear simulation study on local governmental debt risk. A potential semantic analysis model based on Gaussian probability is presented and compared with other methods, and experimental results show that this model can provide a robust, over-the-top anomaly detection in a fully automated, data-driven solution.

Detecting Abnormal Traffic in Wireless Networks Using Unsupervised Models

2016 ◽  
pp. 1-14
Author(s):  
Alexis Huet
Keyword(s):  
High Speed ◽  
Semantic Analysis ◽  
Technical Problem ◽  
Gaussian Mixture Models ◽  
Gaussian Mixture ◽  
Probabilistic Latent Semantic Analysis ◽  
Traffic Data ◽  
Time Stamps ◽  
Continuous Stream ◽  
New Type

Development of high-speed LTE connections has induced an increasingly quantity of traffic data over the network. Detection of abnormal traffic from this continuous stream of data is crucial to identify technical problem or fraudulent intrusion. Unsupervised learning methods can automatically describe structure of the data and deduce patterns of the network. There are useful to identify unexpected behaviors and to promptly detect new type of anomalies. In this article, traffic in wireless network is analyzed through different unsupervised models. Emphasis is given on models combining traffic data with time stamps information. A model called Gaussian Probabilistic Latent Semantic Analysis (GPLSA) is introduced and compared with other methods such as time-dependent Gaussian Mixture Models (time-GMM). Efficiency and robustness of those models are compared, using both sampled and LTE traffic data. Those experimental results suggest that GPLSA can provide a robust and early detection of anomalies, in a fully automatic, data-driven solution.

Dimensional Reduction of Word-Frequency Data as a Substitute for Intersubjective Content Analysis

2004 ◽  
Vol 12 (1) ◽  
pp. 63-75 ◽  
Author(s):  
Adam F. Simon ◽  
Michael Xenos
Keyword(s):  
Factor Analysis ◽  
Content Analysis ◽  
Dimensional Reduction ◽  
Semantic Analysis ◽  
Data Driven ◽  
Data Preparation ◽  
Factor Analyses ◽  
Exploratory Factor Analyses ◽  
Survey Responses ◽  
Word Frequencies

This paper presents a method for using dimensional reduction in the analysis of political content. We draw inspiration from latent semantic analysis (LSA) theory, which posits that factor analysis can successfully model human language. We suggest that the factor analysis of word frequencies generated from any political text—for example, open-ended survey responses—provides adequate content analysis categories and can substitute for more commonly practiced techniques. The method proceeds in three steps: data preparation, exploratory factor analyses, and hypothesis testing. This method may produce other benefits by allowing the data to speak more clearly in the development of coding dictionaries while avoiding the problems of inferential circularity common in other data-driven approaches. We demonstrate the method using responses collected in the execution of an experimental design dealing with the topic of partial-birth abortion and assess the demonstration by presenting a human coding of the same material.

scholarly journals Data-Driven Stability Assessment of Multilayer Long Short-Term Memory Networks

2021 ◽  
Vol 11 (4) ◽  
pp. 1829
Author(s):  
Davide Grande ◽  
Catherine A. Harris ◽  
Giles Thomas ◽  
Enrico Anderlini
Keyword(s):  
Neural Network ◽  
Network Architecture ◽  
Short Term Memory ◽  
Moving Average ◽  
Machine Learning Algorithms ◽  
Physical Models ◽  
Data Driven ◽  
The Stability ◽  
And Control ◽  
Nonlinear Autoregressive

Recurrent Neural Networks (RNNs) are increasingly being used for model identification, forecasting and control. When identifying physical models with unknown mathematical knowledge of the system, Nonlinear AutoRegressive models with eXogenous inputs (NARX) or Nonlinear AutoRegressive Moving-Average models with eXogenous inputs (NARMAX) methods are typically used. In the context of data-driven control, machine learning algorithms are proven to have comparable performances to advanced control techniques, but lack the properties of the traditional stability theory. This paper illustrates a method to prove a posteriori the stability of a generic neural network, showing its application to the state-of-the-art RNN architecture. The presented method relies on identifying the poles associated with the network designed starting from the input/output data. Providing a framework to guarantee the stability of any neural network architecture combined with the generalisability properties and applicability to different fields can significantly broaden their use in dynamic systems modelling and control.

scholarly journals Data-Driven Analysis on Inter-City Commuting Decisions in Germany

2021 ◽  
Vol 13 (11) ◽  
pp. 6320
Author(s):  
Hui Chen ◽  
Sven Voigt ◽  
Xiaoming Fu
Keyword(s):  
Good Accuracy ◽  
Housing Price ◽  
Machine Learning Algorithms ◽  
Data Driven ◽  
Steady Increase ◽  
Time Duration ◽  
Major Bottleneck ◽  
Potential Factors ◽  
Commuting Patterns ◽  
Industry Sectors

Understanding commuters’ behavior and influencing factors becomes more and more important every day. With the steady increase of the number of commuters, commuter traffic becomes a major bottleneck for many cities. Commuter behavior consequently plays an increasingly important role in city and transport planning and policy making. Although prior studies investigated a variety of potential factors influencing commuting decisions, most of them are constrained by the data scale in terms of limited time duration, space and number of commuters under investigation, largely owing to their dependence on questionnaires or survey panel data; as such only small sets of features can be explored and no predictions of commuter numbers have been made, to the best of our knowledge. To fill this gap, we collected inter-city commuting data in Germany between 1994 and 2018, and, along with other data sources, analyzed the influence of GDP, housing and the labor market on the decision to commute. Our analysis suggests that the access to employment opportunities, housing price, income and the distribution of the location’s industry sectors are important factors in commuting decisions. In addition, different age, gender and income groups have different commuting patterns. We employed several machine learning algorithms to predict the commuter number using the identified related features with reasonably good accuracy.

scholarly journals On the Experimental, Numerical and Data-Driven Methods to Study Urban Flows

Energies ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 1310
Author(s):  
Pablo Torres ◽  
Soledad Le Clainche ◽  
Ricardo Vinuesa
Keyword(s):  
Physical Phenomenon ◽  
Urban Pollution ◽  
Pollutant Dispersion ◽  
Urban Environments ◽  
Machine Learning Algorithms ◽  
Data Driven ◽  
Thermal Fields ◽  
Use Of Data ◽  
Sustainability Challenges ◽  
New Research

Understanding the flow in urban environments is an increasingly relevant problem due to its significant impact on air quality and thermal effects in cities worldwide. In this review we provide an overview of efforts based on experiments and simulations to gain insight into this complex physical phenomenon. We highlight the relevance of coherent structures in urban flows, which are responsible for the pollutant-dispersion and thermal fields in the city. We also suggest a more widespread use of data-driven methods to characterize flow structures as a way to further understand the dynamics of urban flows, with the aim of tackling the important sustainability challenges associated with them. Artificial intelligence and urban flows should be combined into a new research line, where classical data-driven tools and machine-learning algorithms can shed light on the physical mechanisms associated with urban pollution.

Data-driven inferences of agency-level risk and response communication on COVID-19 through social media-based interactions

2021 ◽  
Vol 19 (7) ◽  
pp. 59-82
Author(s):  
Md Ashraf Ahmed, PhD Candidate ◽  
Arif Mohaimin Sadri, PhD ◽  
M. Hadi Amini, PhD, DEng
Keyword(s):  
Public Health ◽  
Social Media ◽  
Information Dissemination ◽  
Topic Model ◽  
Face Mask ◽  
Community Response ◽  
Machine Learning Algorithms ◽  
Data Driven ◽  
Contact Tracing ◽  
Online Social Media

Risk perception and risk averting behaviors of public agencies in the emergence and spread of COVID-19 can be retrieved through online social media (Twitter), and such interactions can be echoed in other information outlets. This study collected time-sensitive online social media data and analyzed patterns of health risk communication of public health and emergency agencies in the emergence and spread of novel coronavirus using data-driven methods. The major focus is toward understanding how policy-making agencies communicate risk and response information through social media during a pandemic and influence community response—ie, timing of lockdown, timing of reopening, etc.—and disease outbreak indicators—ie, number of confirmed cases and number of deaths. Twitter data of six major public organizations (1,000-4,500 tweets per organization) are collected from February 21, 2020 to June 6, 2020. Several machine learning algorithms, including dynamic topic model and sentiment analysis, are applied over time to identify the topic dynamics over the specific timeline of the pandemic. Organizations emphasized on various topics—eg, importance of wearing face mask, home quarantine, understanding the symptoms, social distancing and contact tracing, emerging community transmission, lack of personal protective equipment, COVID-19 testing and medical supplies, effect of tobacco, pandemic stress management, increasing hospitalization rate, upcoming hurricane season, use of convalescent plasma for COVID-19 treatment, maintaining hygiene, and the role of healthcare podcast in different timeline. The findings can benefit emergency management, policymakers, and public health agencies to identify targeted information dissemination policies for public with diverse needs based on how local, federal, and international agencies reacted to COVID-19.

Sign in / Sign up

Export Citation Format

Share Document