scholarly journals Analysis of Data Preprocessing Increasing the Oversampling Ratio for Extremely Imbalanced Big Data Classification

2015 ◽  
Author(s):  
Sara del Rio ◽  
Jose Manuel Benitez ◽  
Francisco Herrera
Keyword(s):  
Big Data ◽  
Data Classification ◽  
Data Preprocessing ◽  
Big Data Classification ◽  
Oversampling Ratio

Research on complex attribute big data classification based on iterative fuzzy clustering algorithm

2021 ◽  
pp. 1-12
Author(s):  
Li Qian
Keyword(s):  
Big Data ◽  
Fuzzy Clustering ◽  
Classification Accuracy ◽  
Clustering Algorithm ◽  
Principal Component ◽  
Data Classification ◽  
Fisher Discriminant Analysis ◽  
Fuzzy Clustering Algorithm ◽  
Local Fisher Discriminant Analysis ◽  
Big Data Classification

In order to overcome the low classification accuracy of traditional methods, this paper proposes a new classification method of complex attribute big data based on iterative fuzzy clustering algorithm. Firstly, principal component analysis and kernel local Fisher discriminant analysis were used to reduce dimensionality of complex attribute big data. Then, the Bloom Filter data structure is introduced to eliminate the redundancy of the complex attribute big data after dimensionality reduction. Secondly, the redundant complex attribute big data is classified in parallel by iterative fuzzy clustering algorithm, so as to complete the complex attribute big data classification. Finally, the simulation results show that the accuracy, the normalized mutual information index and the Richter’s index of the proposed method are close to 1, the classification accuracy is high, and the RDV value is low, which indicates that the proposed method has high classification effectiveness and fast convergence speed.

scholarly journals Research on the Construction of Big Data Classification System Based on Distributed Data Flow

2021 ◽  
Vol 2136 (1) ◽  
pp. 012057
Author(s):  
Han Zhou
Keyword(s):  
Big Data ◽  
New Technologies ◽  
Data Classification ◽  
Classification Model ◽  
Distributed Data ◽  
Analysis Model ◽  
Database Construction ◽  
Big Data Classification ◽  
Operation Status ◽  
Model Algorithm

Abstract In the context of the comprehensive popularization of network technical services and database construction system, more and more data are used by enterprises or individuals. It is difficult for the existing technology to meet the technical analysis requirements of the development of the era of big data. Therefore, in the development of practice, we should continue to explore new technologies and methods to reasonably use big data. Therefore, on the basis of understanding the current big data technology and its system operation status, this paper designs relevant algorithms according to the big data classification model, and verifies the effectiveness of the analysis model algorithm based on practice.

Sign in / Sign up

Export Citation Format

Share Document