Predictive Principal Component Analysis as a Data Compression Core in a Simulation Data Management System

2015 ◽  
Author(s):  
Stefan Mertler ◽  
Stefan P. Muller ◽  
Clemens-August Thole
Keyword(s):  
Principal Component Analysis ◽  
Data Management ◽  
Data Compression ◽  
Management System ◽  
Principal Component ◽  
Component Analysis ◽  
Data Management System ◽  
Simulation Data

scholarly journals Hyperspectral data compression based upon the principal component analysis

2021 ◽  
Vol 45 (2) ◽  
pp. 235-244
Author(s):  
A.S. Minkin ◽  
O.V. Nikolaeva ◽  
A.A. Russkov
Keyword(s):  
Principal Component Analysis ◽  
Data Compression ◽  
Principal Component ◽  
Component Analysis ◽  
Hyperspectral Data ◽  
Gas Absorption ◽  
Absorption Bands ◽  
Spectral Bands ◽  
The Mean ◽  
Retrieval Errors

The paper is aimed at developing an algorithm of hyperspectral data compression that combines small losses with high compression rate. The algorithm relies on a principal component analysis and a method of exhaustion. The principal components are singular vectors of an initial signal matrix, which are found by the method of exhaustion. A retrieved signal matrix is formed in parallel. The process continues until a required retrieval error is attained. The algorithm is described in detail and input and output parameters are specified. Testing is performed using AVIRIS data (Airborne Visible-Infrared Imaging Spectrometer). Three images of differently looking sky (clear sky, partly clouded sky, and overcast skies) are analyzed. For each image, testing is performed for all spectral bands and for a set of bands from which high water-vapour absorption bands are excluded. Retrieval errors versus compression rates are presented. The error formulas include the root mean square deviation, the noise-to-signal ratio, the mean structural similarity index, and the mean relative deviation. It is shown that the retrieval errors decrease by more than an order of magnitude if spectral bands with high gas absorption are disregarded. It is shown that the reason is that weak signals in the absorption bands are measured with great errors, leading to a weak dependence between the spectra in different spatial pixels. A mean cosine distance between the spectra in different spatial pixels is suggested to be used to assess the image compressibility.

Data Compression and Reconstruction for EV Charging Stations Based on Principal Component Analysis

2014 ◽  
Vol 556-562 ◽  
pp. 4317-4320
Author(s):  
Qiang Zhang ◽  
Li Ping Liu ◽  
Chao Liu
Keyword(s):  
Principal Component Analysis ◽  
Data Compression ◽  
Simulated Data ◽  
Principal Component ◽  
Component Analysis ◽  
Reconstruction Error ◽  
Data Reconstruction ◽  
Reconstruction Method ◽  
Charging Stations ◽  
Ev Charging

As a zero-emission mode of transportation, an increasing number of Electric Vehicles (EV) have come into use in our daily lives. The EV charging station is an important component of the Smart Grid which is now facing the challenges of big data. This paper presents a data compression and reconstruction method based on the technique of Principal Component Analysis (PCA). The data reconstruction error Normalized Absolute Percent Error (NAPE) is taken into consideration to balance the compression ratio and data reconstruction quality. By using the simulated data, the effectiveness of data compression and reconstruction for EV charging stations are verified.

Sign in / Sign up

Export Citation Format

Share Document