Weighted Voting-Based Effective Free-Viewing Attention Prediction On Web Image Elements

2020 ◽  
Vol 32 (2) ◽  
pp. 170-184
Author(s):  
Sandeep Vidyapu ◽  
Vijaya Saradhi Vedula ◽  
Samit Bhattacharya

Abstract Quantifying and predicting the user attention on web image elements finds applications in synthesis and rendering of elements on webpages. However, the majority of the existing approaches either overlook the visual characteristics of these elements or do not incorporate the users’ visual attention. Especially, obtaining a representative quantified attention (for images) from the attention allocation of multiple users is a challenging task. Toward overcoming the challenge for free-viewing attention, this paper introduces four weighted voting strategies to assign effective visual attention (fixation index (FI)) for web image elements. Subsequently, the prominent image visual features in explaining the assigned attention are identified. Further, the association between image visual features and the assigned attention is modeled as a multi-class prediction problem, which is solved through support vector machine-based classification. The analysis of the proposed approach on real-world webpages reveals the following: (i) image element’s position, size and mid-level color histograms are highly informative for the four weighting schemes; (ii) the presented computational approach outperforms the baseline for four weighted voting schemes with an average accuracy of 85% and micro F1-score of 60%; and (iii) uniform weighting (same weight for all FIs) is adequate for estimating the user’s initial attention while the proportional weighting (weight the FI in proportion to its likelihood of occurrence) extends to the latter attention prediction.

Author(s):  
Sui Haigang ◽  
Song Zhina

Reliably ship detection in optical satellite images has a wide application in both military and civil fields. However, this problem is very difficult in complex backgrounds, such as waves, clouds, and small islands. Aiming at these issues, this paper explores an automatic and robust model for ship detection in large-scale optical satellite images, which relies on detecting statistical signatures of ship targets, in terms of biologically-inspired visual features. This model first selects salient candidate regions across large-scale images by using a mechanism based on biologically-inspired visual features, combined with visual attention model with local binary pattern (CVLBP). Different from traditional studies, the proposed algorithm is high-speed and helpful to focus on the suspected ship areas avoiding the separation step of land and sea. Largearea images are cut into small image chips and analyzed in two complementary ways: Sparse saliency using visual attention model and detail signatures using LBP features, thus accordant with sparseness of ship distribution on images. Then these features are employed to classify each chip as containing ship targets or not, using a support vector machine (SVM). After getting the suspicious areas, there are still some false alarms such as microwaves and small ribbon clouds, thus simple shape and texture analysis are adopted to distinguish between ships and nonships in suspicious areas. Experimental results show the proposed method is insensitive to waves, clouds, illumination and ship size.


Author(s):  
Artittayapron Rojarath ◽  
Wararat Songpan

AbstractEnsemble learning is an algorithm that utilizes various types of classification models. This algorithm can enhance the prediction efficiency of component models. However, the efficiency of combining models typically depends on the diversity and accuracy of the predicted results of ensemble models. However, the problem of multi-class data is still encountered. In the proposed approach, cost-sensitive learning was implemented to evaluate the prediction accuracy for each class, which was used to construct a cost-sensitivity matrix of the true positive (TP) rate. This TP rate can be used as a weight value and combined with a probability value to drive ensemble learning for a specified class. We proposed an ensemble model, which was a type of heterogenous model, namely, a combination of various individual classification models (support vector machine, Bayes, K-nearest neighbour, naïve Bayes, decision tree, and multi-layer perceptron) in experiments on 3-, 4-, 5- and 6-classifier models. The efficiencies of the propose models were compared to those of the individual classifier model and homogenous models (Adaboost, bagging, stacking, voting, random forest, and random subspaces) with various multi-class data sets. The experimental results demonstrate that the cost-sensitive probability for the weighted voting ensemble model that was derived from 3 models provided the most accurate results for the dataset in multi-class prediction. The objective of this study was to increase the efficiency of predicting classification results in multi-class classification tasks and to improve the classification results.


Author(s):  
Sui Haigang ◽  
Song Zhina

Reliably ship detection in optical satellite images has a wide application in both military and civil fields. However, this problem is very difficult in complex backgrounds, such as waves, clouds, and small islands. Aiming at these issues, this paper explores an automatic and robust model for ship detection in large-scale optical satellite images, which relies on detecting statistical signatures of ship targets, in terms of biologically-inspired visual features. This model first selects salient candidate regions across large-scale images by using a mechanism based on biologically-inspired visual features, combined with visual attention model with local binary pattern (CVLBP). Different from traditional studies, the proposed algorithm is high-speed and helpful to focus on the suspected ship areas avoiding the separation step of land and sea. Largearea images are cut into small image chips and analyzed in two complementary ways: Sparse saliency using visual attention model and detail signatures using LBP features, thus accordant with sparseness of ship distribution on images. Then these features are employed to classify each chip as containing ship targets or not, using a support vector machine (SVM). After getting the suspicious areas, there are still some false alarms such as microwaves and small ribbon clouds, thus simple shape and texture analysis are adopted to distinguish between ships and nonships in suspicious areas. Experimental results show the proposed method is insensitive to waves, clouds, illumination and ship size.


2019 ◽  
Vol 16 (4) ◽  
pp. 317-324
Author(s):  
Liang Kong ◽  
Lichao Zhang ◽  
Xiaodong Han ◽  
Jinfeng Lv

Protein structural class prediction is beneficial to protein structure and function analysis. Exploring good feature representation is a key step for this prediction task. Prior works have demonstrated the effectiveness of the secondary structure based feature extraction methods especially for lowsimilarity protein sequences. However, the prediction accuracies still remain limited. To explore the potential of secondary structure information, a novel feature extraction method based on a generalized chaos game representation of predicted secondary structure is proposed. Each protein sequence is converted into a 20-dimensional distance-related statistical feature vector to characterize the distribution of secondary structure elements and segments. The feature vectors are then fed into a support vector machine classifier to predict the protein structural class. Our experiments on three widely used lowsimilarity benchmark datasets (25PDB, 1189 and 640) show that the proposed method achieves superior performance to the state-of-the-art methods. It is anticipated that our method could be extended to other graphical representations of protein sequence and be helpful in future protein research.


Author(s):  
Zepei Wu ◽  
Shuo Liu ◽  
Delong Zhao ◽  
Ling Yang ◽  
Zixin Xu ◽  
...  

AbstractCloud particles have different shapes in the atmosphere. Research on cloud particle shapes plays an important role in analyzing the growth of ice crystals and the cloud microphysics. To achieve an accurate and efficient classification algorithm on ice crystal images, this study uses image-based morphological processing and principal component analysis, to extract features of images and apply intelligent classification algorithms for the Cloud Particle Imager (CPI). Currently, there are mainly two types of ice-crystal classification methods: one is the mode parameterization scheme, and the other is the artificial intelligence model. Combined with data feature extraction, the dataset was tested on ten types of classifiers, and the highest average accuracy was 99.07%. The fastest processing speed of the real-time data processing test was 2,000 images/s. In actual application, the algorithm should consider the processing speed, because the images are in the order of millions. Therefore, a support vector machine (SVM) classifier was used in this study. The SVM-based optimization algorithm can classify ice crystals into nine classes with an average accuracy of 95%, blurred frame accuracy of 100%, with a processing speed of 2,000 images/s. This method has a relatively high accuracy and faster classification processing speed than the classic neural network model. The new method could be also applied in physical parameter analysis of cloud microphysics.


2020 ◽  
Vol 10 (18) ◽  
pp. 6417 ◽  
Author(s):  
Emanuele Lattanzi ◽  
Giacomo Castellucci ◽  
Valerio Freschi

Most road accidents occur due to human fatigue, inattention, or drowsiness. Recently, machine learning technology has been successfully applied to identifying driving styles and recognizing unsafe behaviors starting from in-vehicle sensors signals such as vehicle and engine speed, throttle position, and engine load. In this work, we investigated the fusion of different external sensors, such as a gyroscope and a magnetometer, with in-vehicle sensors, to increase machine learning identification of unsafe driver behavior. Starting from those signals, we computed a set of features capable to accurately describe the behavior of the driver. A support vector machine and an artificial neural network were then trained and tested using several features calculated over more than 200 km of travel. The ground truth used to evaluate classification performances was obtained by means of an objective methodology based on the relationship between speed, and lateral and longitudinal acceleration of the vehicle. The classification results showed an average accuracy of about 88% using the SVM classifier and of about 90% using the neural network demonstrating the potential capability of the proposed methodology to identify unsafe driver behaviors.


Sensors ◽  
2020 ◽  
Vol 20 (9) ◽  
pp. 2630 ◽  
Author(s):  
Erika Rovini ◽  
Carlo Maremmani ◽  
Filippo Cavallo

Objective assessment of the motor evaluation test for Parkinson’s disease (PD) diagnosis is an open issue both for clinical and technical experts since it could improve current clinical practice with benefits both for patients and healthcare systems. In this work, a wearable system composed of four inertial devices (two SensHand and two SensFoot), and related processing algorithms for extracting parameters from limbs motion was tested on 40 healthy subjects and 40 PD patients. Seventy-eight and 96 kinematic parameters were measured from lower and upper limbs, respectively. Statistical and correlation analysis allowed to define four datasets that were used to train and test five supervised learning classifiers. Excellent discrimination between the two groups was obtained with all the classifiers (average accuracy ranging from 0.936 to 0.960) and all the datasets (average accuracy ranging from 0.953 to 0.966), over three conditions that included parameters derived from lower, upper or all limbs. The best performances (accuracy = 1.00) were obtained when classifying all the limbs with linear support vector machine (SVM) or gaussian SVM. Even if further studies should be done, the current results are strongly promising to improve this system as a support tool for clinicians in objectifying PD diagnosis and monitoring.


2017 ◽  
Vol 27 (08) ◽  
pp. 1750033 ◽  
Author(s):  
Alborz Rezazadeh Sereshkeh ◽  
Robert Trott ◽  
Aurélien Bricout ◽  
Tom Chau

Brain–computer interfaces (BCIs) for communication can be nonintuitive, often requiring the performance of hand motor imagery or some other conversation-irrelevant task. In this paper, electroencephalography (EEG) was used to develop two intuitive online BCIs based solely on covert speech. The goal of the first BCI was to differentiate between 10[Formula: see text]s of mental repetitions of the word “no” and an equivalent duration of unconstrained rest. The second BCI was designed to discern between 10[Formula: see text]s each of covert repetition of the words “yes” and “no”. Twelve participants used these two BCIs to answer yes or no questions. Each participant completed four sessions, comprising two offline training sessions and two online sessions, one for testing each of the BCIs. With a support vector machine and a combination of spectral and time-frequency features, an average accuracy of [Formula: see text] was reached across participants in the online classification of no versus rest, with 10 out of 12 participants surpassing the chance level (60.0% for [Formula: see text]). The online classification of yes versus no yielded an average accuracy of [Formula: see text], with eight participants exceeding the chance level. Task-specific changes in EEG beta and gamma power in language-related brain areas tended to provide discriminatory information. To our knowledge, this is the first report of online EEG classification of covert speech. Our findings support further study of covert speech as a BCI activation task, potentially leading to the development of more intuitive BCIs for communication.


2021 ◽  
Author(s):  
Syeda Nadia Firdaus

This thesis explores machine learning models based on various feature sets to solve the protein structural class prediction problem which is a significant classification problem in bioinformatics. Knowledge of protein structural classes contributes to an understanding of protein folding patterns, and this has made structural class prediction research a major topic of interest. In this thesis, features are extracted from predicted secondary structure and hydropathy sequence using new strategies to classify proteins into one of the four major structural classes: all-α, all-β, α/β, and α+β. The prediction accuracy using these features compares favourably with some existing successful methods. We use Support Vector Machines (SVM), since this learning method has well-known efficiency in solving this classification problem. On a standard dataset (25PDB), the proposed system has an overall accuracy of 89% with as few as 22 features, whereas the previous best performing method had an accuracy of 88% using 2510 features.


Author(s):  
Adil Gürsel Karaçor ◽  
Turan Erman Erkan

The possibility to enhance prediction accuracy for foreign exchange rates was investigated in two ways: first applying an outside the box approach to modeling price graphs by exploiting their visual properties, and secondly employing the most efficient methods to detect patterns to classify the direction of movement. The approach that exploits the visual properties of price graphs which make use of density regions along with high and low values describing the shape; hence, the authors propose the name ‘Finance Vision.' The data used in the predictive model consists of 1-hour past price values of 4 different currency pairs, between 2003 and 2016. Prediction performances of state-of-the-art methods; Extreme Gradient Boosting, Artificial Neural Network and Support Vector Machines are compared over the same data with the same sets of features. Results show that density based visual features contribute considerably to prediction performance.


Sign in / Sign up

Export Citation Format

Share Document