DMFD: Non-Intrusive Dependency Inference and Flow Ratio Model for Performance Anomaly Detection in Multi-Tier Cloud Applications

2019 ◽  
Author(s):  
Senbo Fu ◽  
Rui Prior ◽  
Hyong Kim
Keyword(s):  
Anomaly Detection ◽  
Ratio Model ◽  
Flow Ratio ◽  
Performance Anomaly ◽  
Cloud Applications

scholarly journals An Enterprise Time Series Forecasting System for Cloud Applications Using Transfer Learning

Sensors ◽  
2021 ◽  
Vol 21 (5) ◽  
pp. 1590
Author(s):  
Arnak Poghosyan ◽  
Ashot Harutyunyan ◽  
Naira Grigoryan ◽  
Clement Pang ◽  
George Oganesyan ◽  
...  
Keyword(s):  
Time Series ◽  
Anomaly Detection ◽  
Transfer Learning ◽  
Performance Monitoring ◽  
Nonlinear Problems ◽  
Time Series Forecasting ◽  
Stationary Time Series ◽  
Learning Gain ◽  
Application Performance ◽  
Cloud Applications

The main purpose of an application performance monitoring/management (APM) software is to ensure the highest availability, efficiency and security of applications. An APM software accomplishes the main goals through automation, measurements, analysis and diagnostics. Gartner specifies the three crucial capabilities of APM softwares. The first is an end-user experience monitoring for revealing the interactions of users with application and infrastructure components. The second is application discovery, diagnostics and tracing. The third key component is machine learning (ML) and artificial intelligence (AI) powered data analytics for predictions, anomaly detection, event correlations and root cause analysis. Time series metrics, logs and traces are the three pillars of observability and the valuable source of information for IT operations. Accurate, scalable and robust time series forecasting and anomaly detection are the requested capabilities of the analytics. Approaches based on neural networks (NN) and deep learning gain an increasing popularity due to their flexibility and ability to tackle complex nonlinear problems. However, some of the disadvantages of NN-based models for distributed cloud applications mitigate expectations and require specific approaches. We demonstrate how NN-models, pretrained on a global time series database, can be applied to customer specific data using transfer learning. In general, NN-models adequately operate only on stationary time series. Application to nonstationary time series requires multilayer data processing including hypothesis testing for data categorization, category specific transformations into stationary data, forecasting and backward transformations. We present the mathematical background of this approach and discuss experimental results based on implementation for Wavefront by VMware (an APM software) while monitoring real customer cloud environments.

Distributed predictive performance anomaly detection for virtualised platforms

2018 ◽  
Vol 11 (4) ◽  
pp. 279 ◽  
Author(s):  
Ali Imran Jehangiri ◽  
Ramin Yahyapour ◽  
Edwin Yaqub ◽  
Philipp Wieder
Keyword(s):  
Anomaly Detection ◽  
Predictive Performance ◽  
Performance Anomaly

scholarly journals Performance Anomaly Detection in Web Services: an RNN-based Approach Using Dynamic Quality of Service Features

2020 ◽  
Vol 64 (2) ◽  
pp. 729-752
Author(s):  
Muhammad Hasnain ◽  
Seung Ryul Jeong ◽  
Muhammad Fermi Pasha ◽  
Imran Ghani
Keyword(s):  
Quality Of Service ◽  
Web Services ◽  
Anomaly Detection ◽  
Performance Anomaly ◽  
Dynamic Quality

scholarly journals An Enterprise Time Series Forecasting System for Cloud Applications Using Transfer Learning

2021 ◽  
Author(s):  
Arnak Poghosyan ◽  
Ashot Harutyunyan ◽  
Naira Grigoryan ◽  
Clement Pang ◽  
George Oganesyan ◽  
...  
Keyword(s):  
Time Series ◽  
Anomaly Detection ◽  
Performance Monitoring ◽  
Time Series Forecasting ◽  
Stationary Time Series ◽  
Learning Gain ◽  
Application Performance ◽  
Stationary Time ◽  
Forecasting System ◽  
Cloud Applications

One of the key components of application performance monitoring (APM) software is 2 AI/ML empowered data analytics for predictions, anomaly detection, event correlations and root 3 cause analysis. Time series metrics, logs and traces are three pillars of observability and the valuable 4 source of information for IT operations. Accurate, scalable and robust time series forecasting and 5 anomaly detection are desirable capabilities of the analytics. Approaches based on neural networks 6 (NN) and deep learning gain increasing popularity due to their flexibility and ability to tackle complex 7 non-linear problems. However, some of the disadvantages of NN-based models for distributed cloud 8 applications mitigate expectations and require specific approaches. We demonstrate how NN-models 9 pretrained on a global time series database can be applied to customer specific data using transfer 10 learning. In general, NN-models adequately operate only on stationary time series. Application 11 to non-stationary time series requires multilayer data processing including hypothesis testing for 12 data categorization, category specific transformations into stationary data, forecasting and backward 13 transformations. We present the mathematical background of this approach and discuss experimental 14 results from the productized implementation in Wavefront by VMware (an APM software) while 15 monitoring real customer cloud environments.

Sign in / Sign up

Export Citation Format

Share Document