scholarly journals Training Classifiers under Covariate Shift by Constructing the Maximum Consistent Distribution Subset

2015 ◽  
Vol 2015 ◽  
pp. 1-9 ◽  
Author(s):  
Xu Yu ◽  
Miao Yu ◽  
Li-xun Xu ◽  
Jing Yang ◽  
Zhi-qiang Xie

The assumption that the training and testing samples are drawn from the same distribution is violated under covariate shift setting, and most algorithms for the covariate shift setting try to first estimate distributions and then reweight samples based on the distributions estimated. Due to the difficulty of estimating a correct distribution, previous methods can not get good classification performance. In this paper, we firstly present two types of covariate shift problems. Rather than estimating the distributions, we then desire an effective method to select a maximum subset following the target testing distribution based on feature space split from the auxiliary set or the target training set. Finally, we prove that our subset selection method can consistently deal with both scenarios of covariate shift. Experimental results demonstrate that training a classifier with the selected maximum subset exhibits good generalization ability and running efficiency over those of traditional methods under covariate shift setting.

2005 ◽  
Vol 127 (3) ◽  
pp. 294-303 ◽  
Author(s):  
Piervincenzo Rizzo ◽  
Ivan Bartoli ◽  
Alessandro Marzani ◽  
Francesco Lanza di Scalea

This paper casts pipe inspection by ultrasonic guided waves in a feature extraction and automatic classification framework. The specific defect under investigation is a small notch cut in an ASTM-A53-F steel pipe at depths ranging from 1% to 17% of the pipe cross-sectional area. A semi-analytical finite element method is first used to model wave propagation in the pipe. In the experiment, reflection measurements are taken and six features are extracted from the discrete wavelet decomposition of the raw signals and from the Hilbert and Fourier transforms of the reconstructed signals. A six-dimensional damage index is then constructed, and it is fed to an artificial neural network that classifies the size and the location of the notch. Overall, the wavelet-based multifeature analysis demonstrates good classification performance and robustness against noise and changes in some of the operating parameters.


2013 ◽  
Vol 22 (01) ◽  
pp. 1250038 ◽  
Author(s):  
PEERAPON VATEEKUL ◽  
SAREEWAN DENDAMRONGVIT ◽  
MIROSLAV KUBAT

In “multi-label domains,” where the same example can simultaneously belong to two or more classes, it is customary to induce a separate binary classifier for each class, and then use them all in parallel. As a result, some of these classifiers are induced from imbalanced training sets where one class outnumbers the other – a circumstance known to hurt some machine learning paradigms. In the case of Support Vector Machines (SVM), this suboptimal behavior is explained by the fact that SVM seeks to minimize error rate, a criterion that is in domains of this type misleading. This is why several research groups have studied mechanisms to readjust the bias of SVM's hyperplane. The best of these achieves very good classification performance at the price of impractically high computational costs. We propose here an improvement where these cost are reduced to a small fraction without significantly impairing classification.


2020 ◽  
Author(s):  
Esra Sarac Essiz ◽  
Murat Oturakci

Abstract As a nature-inspired algorithm, artificial bee colony (ABC) is an optimization algorithm that is inspired by the search behaviour of honey bees. The main aim of this study is to examine the effects of the ABC-based feature selection algorithm on classification performance for cyberbullying, which has become a significant worldwide social issue in recent years. With this purpose, the classification performance of the proposed ABC-based feature selection method is compared with three different traditional methods such as information gain, ReliefF and chi square. Experimental results present that ABC-based feature selection method outperforms than three traditional methods for the detection of cyberbullying. The Macro averaged F_measure of the data set is increased from 0.659 to 0.8 using proposed ABC-based feature selection method.


2004 ◽  
Vol 12 (2) ◽  
pp. 223-242 ◽  
Author(s):  
Christian W.G. Lasarczyk ◽  
Peter Dittrich ◽  
Wolfgang Banzhaf

A large training set of fitness cases can critically slow down genetic programming, if no appropriate subset selection method is applied. Such a method allows an individual to be evaluated on a smaller subset of fitness cases. In this paper we suggest a new subset selection method that takes the problem structure into account, while being problem independent at the same time. In order to achieve this, information about the problem structure is acquired during evolutionary search by creating a topology (relationship) on the set of fitness cases. The topology is induced by individuals of the evolving population. This is done by increasing the strength of the relation between two fitness cases, if an individual of the population is able to solve both of them. Our new topology—based subset selection method chooses a subset, such that fitness cases in this subset are as distantly related as is possible with respect to the induced topology. We compare topology—based selection of fitness cases with dynamic subset selection and stochastic subset sampling on four different problems. On average, runs with topology—based selection show faster progress than the others.


2018 ◽  
Vol 18 (4) ◽  
pp. 29-42 ◽  
Author(s):  
Gunjan Ansari ◽  
Tanvir Ahmad ◽  
Mohammad Najmud Doja

Abstract In our work, we propose an ensemble of local and global filter-based feature selection method to reduce the high dimensionality of feature space and increase accuracy of spam review classification. These selected features are then used for training various classifiers for spam detection. Experimental results with four classifiers on two available datasets of hotel reviews show that the proposed feature selector improves the performance of spam classification in terms of well-known performance metrics such as AUC score.


Information ◽  
2019 ◽  
Vol 10 (6) ◽  
pp. 195 ◽  
Author(s):  
Dickson Keddy Wornyo ◽  
Xiang-Jun Shen

The least squares support vector method is a popular data-driven modeling method which shows better performance and has been successfully applied in a wide range of applications. In this paper, we propose a novel coupled least squares support vector ensemble machine (C-LSSVEM). The proposed coupling ensemble helps improve robustness and produce good classification performance than the single model approach. The proposed C-LSSVEM can choose appropriate kernel types and their parameters in a good coupling strategy with a set of classifiers being trained simultaneously. The proposed method can further minimize the total loss of ensembles in kernel space. Thus, we form an ensemble regressor by co-optimizing and weighing base regressors. Experiments conducted on several datasets such as artificial datasets, UCI classification datasets, UCI regression datasets, handwritten digits datasets and NWPU-RESISC45 datasets, indicate that C-LSSVEM performs better in achieving the minimal regression loss and the best classification accuracy relative to selected state-of-the-art regression and classification techniques.


2011 ◽  
Vol 65 ◽  
pp. 199-203
Author(s):  
Sheng Wu Wang ◽  
Xiu Hua Shi ◽  
Hui Xu ◽  
Zhao Jing Tong

Wavelet Analysis extracts the main feature from the fault signal through wavelet transformation, so it is advantageous to withdraw fault characteristic for fault diagnosis. Support Vector Machine (SVM) has shown its good classification performance in fault diagnosis. A new method of fault diagnosis for UV control system based on WAVELET-SVM is raised. The sensor output is sampled in frequency domain and it is preprocessed by wavelet to extract main vectors of the fault features. Fault patterns under various states are classified using multi-class SVM, and fault diagnosis is realized. The simulation results show that WAVELET-SVM is feasible to detect and locate faults quickly and exactly and has high robustness.


2021 ◽  
Author(s):  
Sanjoy Basak ◽  
Sreeraj Rajendran ◽  
Sofie Pollin ◽  
Bart Scheers

Despite several beneficial applications, unfortunately, drones are also being used for illicit activities such as drug trafficking, firearm smuggling or to impose threats to security-sensitive places like airports and nuclear power plants. The existing drone localization and neutralization technologies work on the assumption that the drone has already been detected and classified. Although we have observed a tremendous advancement in the sensor industry in this decade, there is no robust drone detection and classification method proposed in the literature yet. This paper focuses on radio frequency (RF) based drone detection and classification using the frequency signature of the transmitted signal. We have created a novel drone RF dataset using commercial drones and presented a detailed comparison between a two-stage and combined detection and classification framework. The detection and classification performance of both frameworks are presented for a single-signal and simultaneous multi-signal scenario. With detailed analysis, we show that You Only Look Once (YOLO) framework provides better detection performance compared to the Goodness-of-Fit (GoF) spectrum sensing for a simultaneous multi-signal scenario and good classification performance comparable to Deep Residual Neural Network (DRNN) framework.<br>


2021 ◽  
Author(s):  
Sanjoy Basak ◽  
Sreeraj Rajendran ◽  
Sofie Pollin ◽  
Bart Scheers

Despite several beneficial applications, unfortunately, drones are also being used for illicit activities such as drug trafficking, firearm smuggling or to impose threats to security-sensitive places like airports and nuclear power plants. The existing drone localization and neutralization technologies work on the assumption that the drone has already been detected and classified. Although we have observed a tremendous advancement in the sensor industry in this decade, there is no robust drone detection and classification method proposed in the literature yet. This paper focuses on radio frequency (RF) based drone detection and classification using the frequency signature of the transmitted signal. We have created a novel drone RF dataset using commercial drones and presented a detailed comparison between a two-stage and combined detection and classification framework. The detection and classification performance of both frameworks are presented for a single-signal and simultaneous multi-signal scenario. With detailed analysis, we show that You Only Look Once (YOLO) framework provides better detection performance compared to the Goodness-of-Fit (GoF) spectrum sensing for a simultaneous multi-signal scenario and good classification performance comparable to Deep Residual Neural Network (DRNN) framework.<br>


2020 ◽  
Vol 8 (11) ◽  
pp. 952
Author(s):  
Jin-Hyun Park ◽  
Changgu Kang

In the underwater environment, in order to preserve rare and endangered objects or to eliminate the exotic invasive species that can destroy the ecosystems, it is essential to classify objects and estimate their number. It is very difficult to classify objects and estimate their number. While YOLO shows excellent performance in object recognition, it recognizes objects by processing the images of each frame independently of each other. By accumulating the object classification results from the past frames to the current frame, we propose a method to accurately classify objects, and count their number in sequential video images. This has a high classification probability of 93.94% and 97.06% in the test videos of Bluegill and Largemouth bass, respectively. The proposed method shows very good classification performance in video images taken of the underwater environment.


Sign in / Sign up

Export Citation Format

Share Document