Non-subsampled contourlet based feature level fusion using fuzzy logic and golden section algorithm for multisensor imaging systems

Understanding human emotional states is indispensable for our daily interaction, and we can enjoy more natural and friendly human computer interaction (HCI) experience by fully utilizing human’s affective states. In the application of emotion recognition, multimodal information fusion is widely used to discover the relationships of multiple information sources and make joint use of a number of channels, such as speech, facial expression, gesture and physiological processes. This thesis proposes a new framework of emotion recognition using information fusion based on the estimation of information entropy. The novel techniques of information theoretic learning are applied to feature level fusion and score level fusion. The most critical issues for feature level fusion are feature transformation and dimensionality reduction. The existing methods depend on the second order statistics, which is only optimal for Gaussian-like distributions. By incorporating information theoretic tools, a new feature level fusion method based on kernel entropy component analysis is proposed. For score level fusion, most previous methods focus on predefined rule based approaches, which are usually heuristic. In this thesis, a connection between information fusion and maximum correntropy criterion is established for effective score level fusion. Feature level fusion and score level fusion methods are then combined to introduce a two-stage fusion platform. The proposed methods are applied to audiovisual emotion recognition, and their effectiveness is evaluated by experiments on two publicly available audiovisual emotion databases. The experimental results demonstrate that the proposed algorithms achieve improved performance in comparison with the existing methods. The work of this thesis offers a promising direction to design more advanced emotion recognition systems based on multimodal information fusion and has great significance to the development of intelligent human computer interaction systems.

Download Full-text

Intelligent Fault Diagnosis of Synchromesh Gearbox Using Fusion of Vibration and Acoustic Emission Signals for Performance Enhancement

International Journal of Prognostics and Health Management ◽

10.36001/ijphm.2019.v10i2.2738 ◽

2019 ◽

Vol 10 (2) ◽

Author(s):

T Praveenkumar ◽

M Saimurugan ◽

K I Ramachandran

Keyword(s):

Support Vector Machine ◽

Acoustic Emission ◽

Fault Diagnosis ◽

Condition Monitoring ◽

Support Vector ◽

Feature Level Fusion ◽

Sensor Signals ◽

Early Fault Detection ◽

Ae Signals ◽

Level Fusion

Condition monitoring system monitors the system degradation and it identifies common failure modes. Several sensor signals are available for monitoring the changes in system components. Vibration signal is one of the most extensively used technique for monitoring rotating components as it identifies faults before the system fails. Early fault detection is the significant factor for condition monitoring, where Acoustic Emission ( AE ) sensor signals have been applied for early fault detection due to their high sensitivity and high frequency. In this paper, vibration and acoustic emission signals are acquired under various simulated gear and bearing fault conditions from the synchromesh gearbox. Then the statistical features are extracted from vibration and AE signals and then the prominent features are selected using J48 decision tree algorithm respectively. The best features from the vibration and AE signals are then fused using feature-level fusion strategy and it is classified using Support Vector Machine ( SVM ) and Proximal Support Vector Machine ( PSVM ) classifiers and it is compared with individual signals for fault diagnosis of the synchromesh gearbox. From the experiments, it is observed that the performance of the fault diagnosis system has been improved for the proposed feature level fusion technique compared to the performance of unfused vibration and AE feature sets.

Download Full-text