Mobile video processing for visual saliency map determination

2008 ◽  
Author(s):  
Shilin Xu ◽  
Weisi Lin ◽  
C.-C. Jay Kuo
Keyword(s):  
Video Processing ◽  
Visual Saliency ◽  
Saliency Map ◽  
Mobile Video

An Object-Based Image Reducing Approach

2014 ◽  
Vol 1044-1045 ◽  
pp. 1049-1052 ◽  
Author(s):  
Chin Chen Chang ◽  
I Ta Lee ◽  
Tsung Ta Ke ◽  
Wen Kai Tai
Keyword(s):  
Visual Saliency ◽  
Saliency Map ◽  
Input Image ◽  
Image Size ◽  
Target Image ◽  
Feature Maps ◽  
Object Based ◽  
Wide Range

Common methods for reducing image size include scaling and cropping. However, these two approaches have some quality problems for reduced images. In this paper, we propose an image reducing algorithm by separating the main objects and the background. First, we extract two feature maps, namely, an enhanced visual saliency map and an improved gradient map from an input image. After that, we integrate these two feature maps to an importance map. Finally, we generate the target image using the importance map. The proposed approach can obtain desired results for a wide range of images.

Video Objective Quality Evaluation System Based on the Visual Saliency Map

2013 ◽  
Vol 411-414 ◽  
pp. 1362-1367 ◽  
Author(s):  
Qing Lan Wei ◽  
Yuan Zhang
Keyword(s):  
Evaluation System ◽  
Quality Evaluation ◽  
Objective Assessment ◽  
Visual Saliency ◽  
Objective Evaluation ◽  
Subjective Assessment ◽  
Saliency Map ◽  
Assessment Scores ◽  
Objective Quality ◽  
Quality Evaluation System

This paper presents the thoughts about application of saliency map to the video objective quality evaluation system. It computes the SMSE and SPSNR values as the objective assessment scores according to the saliency map, and compares with conditional objective evaluation methods as PSNR and MSE. Experimental results demonstrate that this method can well fit the subjective assessment results.

scholarly journals Ship Detection in Panchromatic Optical Remote Sensing Images Based on Visual Saliency and Multi-Dimensional Feature Description

2020 ◽  
Vol 12 (1) ◽  
pp. 152 ◽  
Author(s):  
Ting Nie ◽  
Xiyu Han ◽  
Bin He ◽  
Xiansheng Li ◽  
Hongxing Liu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Fourier Transform ◽  
Detection Method ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Saliency Map ◽  
False Alarms ◽  
Optical Remote Sensing ◽  
Remote Sensing Images ◽  
Ship Detection

Ship detection in panchromatic optical remote sensing images is faced with two major challenges, locating candidate regions from complex backgrounds quickly and describing ships effectively to reduce false alarms. Here, a practical method was proposed to solve these issues. Firstly, we constructed a novel visual saliency detection method based on a hyper-complex Fourier transform of a quaternion to locate regions of interest (ROIs), which can improve the accuracy of the subsequent discrimination process for panchromatic images, compared with the phase spectrum quaternary Fourier transform (PQFT) method. In addition, the Gaussian filtering of different scales was performed on the transformed result to synthesize the best saliency map. An adaptive method based on GrabCut was then used for binary segmentation to extract candidate positions. With respect to the discrimination stage, a rotation-invariant modified local binary pattern (LBP) description was achieved by combining shape, texture, and moment invariant features to describe the ship targets more powerfully. Finally, the false alarms were eliminated through SVM training. The experimental results on panchromatic optical remote sensing images demonstrated that the presented saliency model under various indicators is superior, and the proposed ship detection method is accurate and fast with high robustness, based on detailed comparisons to existing efforts.

scholarly journals SALIENCY-GUIDED CHANGE DETECTION OF REMOTELY SENSED IMAGES USING RANDOM FOREST

2018 ◽  
Vol XLII-3 ◽  
pp. 341-348
Author(s):  
W. Feng ◽  
H. Sui ◽  
X. Chen
Keyword(s):  
Random Forest ◽  
Change Detection ◽  
Learning Algorithm ◽  
Saliency Detection ◽  
Principal Component ◽  
Visual Saliency ◽  
Saliency Map ◽  
Difference Image ◽  
Fcm Clustering ◽  
Optimal Segmentation

Studies based on object-based image analysis (OBIA) representing the paradigm shift in change detection (CD) have achieved remarkable progress in the last decade. Their aim has been developing more intelligent interpretation analysis methods in the future. The prediction effect and performance stability of random forest (RF), as a new kind of machine learning algorithm, are better than many single predictors and integrated forecasting method. In this paper, we present a novel CD approach for high-resolution remote sensing images, which incorporates visual saliency and RF. First, highly homogeneous and compact image super-pixels are generated using super-pixel segmentation, and the optimal segmentation result is obtained through image superimposition and principal component analysis (PCA). Second, saliency detection is used to guide the search of interest regions in the initial difference image obtained via the improved robust change vector analysis (RCVA) algorithm. The salient regions within the difference image that correspond to the binarized saliency map are extracted, and the regions are subject to the fuzzy <i>c</i>-means (FCM) clustering to obtain the pixel-level pre-classification result, which can be used as a prerequisite for superpixel-based analysis. Third, on the basis of the optimal segmentation and pixel-level pre-classification results, different super-pixel change possibilities are calculated. Furthermore, the changed and unchanged super-pixels that serve as the training samples are automatically selected. The spectral features and Gabor features of each super-pixel are extracted. Finally, superpixel-based CD is implemented by applying RF based on these samples. Experimental results on Ziyuan 3 (ZY3) multi-spectral images show that the proposed method outperforms the compared methods in the accuracy of CD, and also confirm the feasibility and effectiveness of the proposed approach.

scholarly journals Blotch Detection in Archive Films Based on Visual Saliency Map

Complexity ◽  
2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Yildiz Aydin ◽  
Bekir Dizdaroğlu
Keyword(s):  
Computational Complexity ◽  
Cultural Heritage ◽  
False Alarm ◽  
Detection Method ◽  
Visual Saliency ◽  
Saliency Map ◽  
Saliency Maps ◽  
Block Based ◽  
The Given ◽  
Blotch Detection

Degradations frequently occur in archive films that symbolize the historical and cultural heritage of a nation. In this study, the problem of detection blotches commonly encountered in archive films is handled. Here, a block-based blotch detection method is proposed based on a visual saliency map. The visual saliency map reveals prominent areas in an input frame and thus enables more accurate results in the blotch detection. A simple and effective visual saliency map method is taken into consideration in order to reduce computational complexity for the detection phase. After the visual saliency maps of the given frames are obtained, blotch regions are estimated by considered spatiotemporal patches—without the requirement for motion estimation—around the saliency pixels, which are subjected to a prethresholding process. Experimental results show that the proposed block-based blotch detection method provides a significant advantage with reducing false alarm rates over HOG feature (Yous and Serir, 2017), LBP feature (Yous and Serir, 2017), and regions-matching (Yous and Serir, 2016) methods presented in recent years.

scholarly journals Learning-Based Visual Saliency Model for Detecting Diabetic Macular Edema in Retinal Image

2016 ◽  
Vol 2016 ◽  
pp. 1-10 ◽  
Author(s):  
Xiaochun Zou ◽  
Xinbo Zhao ◽  
Yongjia Yang ◽  
Na Li
Keyword(s):  
Macular Edema ◽  
Diabetic Macular Edema ◽  
Retinal Image ◽  
Visual Saliency ◽  
Saliency Map ◽  
Support Vector ◽  
Salient Region Detection ◽  
Region Detection ◽  
Saliency Model ◽  
Visual Saliency Model

This paper brings forth a learning-based visual saliency model method for detecting diagnostic diabetic macular edema (DME) regions of interest (RoIs) in retinal image. The method introduces the cognitive process of visual selection of relevant regions that arises during an ophthalmologist’s image examination. To record the process, we collected eye-tracking data of 10 ophthalmologists on 100 images and used this database as training and testing examples. Based on analysis, two properties (Feature Property and Position Property) can be derived and combined by a simple intersection operation to obtain a saliency map. The Feature Property is implemented by support vector machine (SVM) technique using the diagnosis as supervisor; Position Property is implemented by statistical analysis of training samples. This technique is able to learn the preferences of ophthalmologist visual behavior while simultaneously considering feature uniqueness. The method was evaluated using three popular saliency model evaluation scores (AUC, EMD, and SS) and three quality measurements (classical sensitivity, specificity, and Youden’sJstatistic). The proposed method outperforms 8 state-of-the-art saliency models and 3 salient region detection approaches devised for natural images. Furthermore, our model successfully detects the DME RoIs in retinal image without sophisticated image processing such as region segmentation.

Image Reduction Method for Rice Leaf Disease Based on Visual Attention Model

2012 ◽  
Vol 220-223 ◽  
pp. 1393-1397
Author(s):  
Li Bo Liu ◽  
Chun Jiang Zhao ◽  
Hua Rui Wu ◽  
Rong Hua Gao
Keyword(s):  
Visual Attention ◽  
Digital Camera ◽  
Visual Saliency ◽  
Saliency Map ◽  
Brown Spot ◽  
Visual Attention Model ◽  
Attention Model ◽  
Growth Status ◽  
Leaf Disease ◽  
Brown Spot Disease

Analyzing the crop growth status through leaf disease image is one of the hottest issues in agriculture and forestry fields currently. But the size of image gathered by digital camera is too large, the focus of this research is to zooming-out image at the condition of ensuring the main information which carried by the image to distort lower. Based on the further study of visual attention model proposed by Itti and Ma YF. This paper establishes visual attention and visual saliency map of rice blast and brown spot disease image, whose size is 4272*2878 pixels. Finally, determines the reduction scale of the corresponding effective target collection and provide a new way to reduce the plant leaf images.

scholarly journals Image Modification Based on a Visual Saliency Map for Guiding Visual Attention

2015 ◽  
Vol E98.D (11) ◽  
pp. 1967-1975 ◽  
Author(s):  
Hironori TAKIMOTO ◽  
Tatsuhiko KOKUI ◽  
Hitoshi YAMAUCHI ◽  
Mitsuyoshi KISHIHARA ◽  
Kensuke OKUBO
Keyword(s):  
Visual Attention ◽  
Visual Saliency ◽  
Saliency Map

Ant-Inspired Visual Saliency Detection in Image

2011 ◽  
pp. 263-272
Author(s):  
Jing Tian ◽  
Weiyu Yu
Keyword(s):  
Visual System ◽  
Human Visual System ◽  
Saliency Detection ◽  
Visual Saliency ◽  
Saliency Map ◽  
Experimental Results ◽  
Superior Performance ◽  
Local Phase ◽  
Visual Saliency Detection ◽  
Pheromone Information

Visual saliency detection aims to produce saliency map of images via simulating the behavior of the human visual system (HVS). An ant-inspired approach is proposed in this chapter. The proposed approach is inspired by the ant’s behavior to find the most saliency regions in image, by depositing the pheromone information (through ant’s movements) on the image to measure its saliency. Furthermore, the ant’s movements are steered by the local phase coherence of the image. Experimental results are presented to demonstrate the superior performance of the proposed approach.

Salient Region Detection for Biometric Watermarking

2011 ◽  
pp. 218-236
Author(s):  
Ma Bin ◽  
Li Chun-lei ◽  
Wang Yun-hong ◽  
Bai Xiao
Keyword(s):  
Vision System ◽  
Region Of Interest ◽  
Visual Saliency ◽  
Saliency Map ◽  
Human Vision ◽  
Identification Accuracy ◽  
Biometric Data ◽  
Salient Region Detection ◽  
Salient Region ◽  
Region Detection

Visual saliency, namely the perceptual significance to human vision system (HVS), is a quality that differentiates an object from its neighbors. Detection of salient regions which contain prominent features and represent main contents of the visual scene, has obtained wide utilization among computer vision based applications, such as object tracking and classification, region-of-interest (ROI) based image compression, etc. Specially, as for biometric authentication system, whose objective is to distinguish the identification of people through biometric data (e.g. fingerprint, iris, face etc.), the most important metric is distinguishability. Consequently, in biometric watermarking fields, there has been a great need of good metrics for feature prominency. In this chapter, we present two salient-region-detection based biometric watermarking scenarios, in which robust annotation and fragile authentication watermark are respectively applied to biometric systems. Saliency map plays an important role of perceptual mask that adaptively select watermarking strength and position, therefore controls the distortion introduced by watermark and preserves the identification accuracy of biometric images.

Sign in / Sign up

Export Citation Format

Share Document