Multiple One-Shots for Utilizing Class Label Information

Author(s):  
Yaniv Taigman ◽  
Lior Wolf ◽  
Tal Hassner
Author(s):  
Ya Li ◽  
Xinmei Tian ◽  
Xu Shen ◽  
Dacheng Tao

Deep learning has been proven to be effective for classification problems. However, the majority of previous works trained classifiers by considering only class label information and ignoring the local information from the spatial distribution of training samples. In this paper, we propose a deep learning framework that considers both class label information and local spatial distribution information between training samples. A two-channel network with shared weights is used to measure the local distribution. The classification performance can be improved with more detailed information provided by the local distribution, particularly when the training samples are insufficient. Additionally, the class label information can help to learn better feature representations compared with other feature learning methods that use only local distribution information between samples. The local distribution constraint between sample pairs can also be viewed as a regularization of the network, which can efficiently prevent the overfitting problem. Extensive experiments are conducted on several benchmark image classification datasets, and the results demonstrate the effectiveness of our proposed method.


2012 ◽  
Vol 6-7 ◽  
pp. 583-588
Author(s):  
Yu Qing Shi ◽  
Shi Qiang Du ◽  
Wei Lan Wang

Concept Factorization (CF) is a new matrix decomposition technique for data representation. A modified CF algorithm called Graph Regularized Semi-supervised Concept Factorization (GRSCF) is proposed for addressing the limitations of CF and Local Consistent Concept Factorization (LCCF), which did not consider the geometric structure or the label information of the data. GRSCF preserves the intrinsic geometry of data as regularized term and use the label information as semi-supervised learning, it makes nearby samples with the same class-label are more compact, and nearby classes are separated. Compared with Non-Negative Matrix Factorization (NMF), CNMF, CF and LCCF, experiment results on ORL face database and Coil20 image database have shown that the proposed method achieves better clustering results.


2022 ◽  
Vol 2161 (1) ◽  
pp. 012074
Author(s):  
Hemavati ◽  
V Susheela Devi ◽  
R Aparna

Abstract Nowadays, multi-label classification can be considered as one of the important challenges for classification problem. In this case instances are assigned more than one class label. Ensemble learning is a process of supervised learning where several classifiers are trained to get a better solution for a given problem. Feature reduction can be used to improve the classification accuracy by considering the class label information with principal Component Analysis (PCA). In this paper, stacked ensemble learning method with augmented class information PCA (CA PCA) is proposed for classification of multi-label data (SEMML). In the initial step, the dimensionality reduction step is applied, then the number of classifiers have to be chosen to apply on the original training dataset, then the stacking method is applied to it. By observing the results of experiments conducted are showing our proposed method is working better as compared to the existing methods.


Author(s):  
CHEONG HEE PARK

In semi-supervised learning, when the number of data samples with class label information is very small, information from unlabeled data is utilized in the learning process. Many semi-supervised learning methods have been presented and have exhibited competent performance. Active learning also aims to overcome the shortage of labeled data by obtaining class labels for some selected unlabeled data from experts. However, the selection process for the most informative unlabeled data samples can be demanding when the search is performed over a large set of unlabeled data. In this paper, we propose a method for batch mode active learning in graph-based semi-supervised learning. Instead of acquiring class label information of one unlabeled data sample at a time, we obtain information about several data samples at once, reducing time complexity while preserving the beneficial effects of active learning. Experimental results demonstrate the improved performance of the proposed method.


2014 ◽  
Vol 2014 ◽  
pp. 1-8 ◽  
Author(s):  
Shaoping Zhu

We present a new approach to automatically recognize the pain expression from video sequences, which categorize pain as 4 levels: “no pain,” “slight pain,” “moderate pain,” and “ severe pain.” First of all, facial velocity information, which is used to characterize pain, is determined using optical flow technique. Then visual words based on facial velocity are used to represent pain expression using bag of words. Final pLSA model is used for pain expression recognition, in order to improve the recognition accuracy, the class label information was used for the learning of the pLSA model. Experiments were performed on a pain expression dataset built by ourselves to test and evaluate the proposed method, the experiment results show that the average recognition accuracy is over 92%, which validates its effectiveness.


Author(s):  
Xingzhu Liang ◽  
Yu’e Lin

The manifold-based learning methods have recently drawn more and more attention in dimension reduction. In this paper, a novel manifold-based learning method named enhanced parameter-free diversity discriminant preserving projections (EPFDDPP) is presented, which effectively avoids the neighborhood parameter selection and characterizes the manifold structure well. EPFDDPP redefines the weighted matrices, the discriminating similarity matrix and the discriminating diversity matrix, respectively. The weighted matrices are computed by the cosine angle distance between two data points and take special consideration of both the local information and the class label information, which are parameterless and favorable for face recognition. After characterizing the discriminating similarity scatter matrix and the discriminating diversity scatter matrix, the novel feature extraction criterion is derived based on maximum margin criterion. Experimental results on the Wine data set, Olivetti Research Laboratory (ORL); AR (face database created by Aleix Martinez and Robert Benavente); and Pose, Illumination, and Expression (PIE) face databases show the effectiveness of the proposed method.


Author(s):  
Yong Shin ◽  
Cheong Park

Analysis of correlation based dimension reduction methodsDimension reduction is an important topic in data mining and machine learning. Especially dimension reduction combined with feature fusion is an effective preprocessing step when the data are described by multiple feature sets. Canonical Correlation Analysis (CCA) and Discriminative Canonical Correlation Analysis (DCCA) are feature fusion methods based on correlation. However, they are different in that DCCA is a supervised method utilizing class label information, while CCA is an unsupervised method. It has been shown that the classification performance of DCCA is superior to that of CCA due to the discriminative power using class label information. On the other hand, Linear Discriminant Analysis (LDA) is a supervised dimension reduction method and it is known as a special case of CCA. In this paper, we analyze the relationship between DCCA and LDA, showing that the projective directions by DCCA are equal to the ones obtained from LDA with respect to an orthogonal transformation. Using the relation with LDA, we propose a new method that can enhance the performance of DCCA. The experimental results show that the proposed method exhibits better classification performance than the original DCCA.


Sign in / Sign up

Export Citation Format

Share Document