scholarly journals Blind First-Order Perspective Distortion Correction Using Parallel Convolutional Neural Networks

Sensors ◽  
2020 ◽  
Vol 20 (17) ◽  
pp. 4898
Author(s):  
Neil Patrick Del Gallego ◽  
Joel Ilao ◽  
Macario Cordel
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Network Architecture ◽  
Input Image ◽  
Distortion Correction ◽  
Generative Adversarial Networks ◽  
Adversarial Networks ◽  
Perspective Distortion ◽  
Corrected Image ◽  
Perspective Distortions

In this work, we present a network architecture with parallel convolutional neural networks (CNN) for removing perspective distortion in images. While other works generate corrected images through the use of generative adversarial networks or encoder-decoder networks, we propose a method wherein three CNNs are trained in parallel, to predict a certain element pair in the 3×3 transformation matrix, M^. The corrected image is produced by transforming the distorted input image using M^−1. The networks are trained from our generated distorted image dataset using KITTI images. Experimental results show promise in this approach, as our method is capable of correcting perspective distortions on images and outperforms other state-of-the-art methods. Our method also recovers the intended scale and proportion of the image, which is not observed in other works.

scholarly journals Realtime Emotional Reflective User Interface Based on Deep Convolutional Neural Networks and Generative Adversarial Networks

Electronics ◽  
2021 ◽  
Vol 11 (1) ◽  
pp. 118
Author(s):  
Holly Burrows ◽  
Javad Zarrin ◽  
Lakshmi Babu-Saheer ◽  
Mahdi Maktab-Dar-Oghaz
Keyword(s):  
Artificial Intelligence ◽  
Neural Networks ◽  
User Interface ◽  
Convolutional Neural Networks ◽  
Mental Health Problems ◽  
Well Being ◽  
Working Environment ◽  
Generative Adversarial Networks ◽  
Deep Convolutional Neural Networks ◽  
Adversarial Networks

It is becoming increasingly apparent that a significant amount of the population suffers from mental health problems, such as stress, depression, and anxiety. These issues are a result of a vast range of factors, such as genetic conditions, social circumstances, and lifestyle influences. A key cause, or contributor, for many people is their work; poor mental state can be exacerbated by jobs and a person’s working environment. Additionally, as the information age continues to burgeon, people are increasingly sedentary in their working lives, spending more of their days seated, and less time moving around. It is a well-known fact that a decrease in physical activity is detrimental to mental well-being. Therefore, the need for innovative research and development to combat negativity early is required. Implementing solutions using Artificial Intelligence has great potential in this field of research. This work proposes a solution to this problem domain, utilising two concepts of Artificial Intelligence, namely, Convolutional Neural Networks and Generative Adversarial Networks. A CNN is trained to accurately predict when an individual is experiencing negative emotions, achieving a top accuracy of 80.38% with a loss of 0.42. A GAN is trained to synthesise images from an input domain that can be attributed to evoking position emotions. A Graphical User Interface is created to display the generated media to users in order to boost mood and reduce feelings of stress. The work demonstrates the capability for using Deep Learning to identify stress and negative mood, and the strategies that can be implemented to reduce them.

scholarly journals Counting Crowds with Perspective Distortion Correction via Adaptive Learning

Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3781
Author(s):  
Yixuan Sun ◽  
Jian Jin ◽  
Xingjiao Wu ◽  
Tianlong Ma ◽  
Jing Yang
Keyword(s):  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Adaptive Learning ◽  
Perspective Transformation ◽  
Distortion Correction ◽  
Data Sets ◽  
Original Image ◽  
Learning Network ◽  
Perspective Distortion ◽  
Counting Data

The goal of crowd counting is to estimate the number of people in the image. Presently, use regression to count people number became a mainstream method. It is worth noting that, with the development of convolutional neural networks (CNN), methods that are based on CNN have become a research hotspot. It is a more interesting topic that how to locate the site of the person in the image than simply predicting the number of people in the image. The perspective transformation present is still a challenge, because perspective distortion will cause differences in the size of the crowd in the image. To devote perspective distortion and locate the site of the person more accuracy, we design a novel framework named Adaptive Learning Network (CAL). We use the VGG as the backbone. After each pooling layer is output, we collect the 1/2, 1/4, 1/8, and 1/16 features of the original image and combine them with the weights learned by an adaptive learning branch. The object of our adaptive learning branch is each image in the datasets. By combining the output features of different sizes of each image, the challenge of drastic changes in the size of the image crowd due to perspective transformation is reduced. We conducted experiments on four population counting data sets (i.e., ShanghaiTech Part A, ShanghaiTech Part B, UCF_CC_50 and UCF-QNRF), and the results show that our model has a good performance.

scholarly journals Novel convolutional neural networks for efficient classification of rotated and scaled images

2021 ◽  
Author(s):  
Paweł Tarasiuk ◽  
Piotr S. Szczepaniak
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Networks ◽  
Network Architecture ◽  
Data Augmentation ◽  
Network Models ◽  
Input Image ◽  
Feature Maps ◽  
Neural Network Models ◽  
Geometric Transformations

AbstractThis paper presents a novel method for improving the invariance of convolutional neural networks (CNNs) to selected geometric transformations in order to obtain more efficient image classifiers. A common strategy employed to achieve this aim is to train the network using data augmentation. Such a method alone, however, increases the complexity of the neural network model, as any change in the rotation or size of the input image results in the activation of different CNN feature maps. This problem can be resolved by the proposed novel convolutional neural network models with geometric transformations embedded into the network architecture. The evaluation of the proposed CNN model is performed on the image classification task with the use of diverse representative data sets. The CNN models with embedded geometric transformations are compared to those without the transformations, using different data augmentation setups. As the compared approaches use the same amount of memory to store the parameters, the improved classification score means that the proposed architecture is more optimal.

scholarly journals Deep Convolutional Neural Networks With Ensemble Learning and Generative Adversarial Networks for Alzheimer’s Disease Image Data Classification

2021 ◽  
Vol 13 ◽  
Author(s):  
Robert Logan ◽  
Brian G. Williams ◽  
Maria Ferreira da Silva ◽  
Akash Indani ◽  
Nicolas Schcolnicov ◽  
...  
Keyword(s):  
Alzheimer’S Disease ◽  
Neural Networks ◽  
Alzheimer's Disease ◽  
Early Detection ◽  
Ensemble Learning ◽  
Convolutional Neural Networks ◽  
Unmet Need ◽  
Generative Adversarial Networks ◽  
Adversarial Networks ◽  
Interdisciplinary Approaches

Recent advancements in deep learning (DL) have made possible new methodologies for analyzing massive datasets with intriguing implications in healthcare. Convolutional neural networks (CNN), which have proven to be successful supervised algorithms for classifying imaging data, are of particular interest in the neuroscience community for their utility in the classification of Alzheimer’s disease (AD). AD is the leading cause of dementia in the aging population. There remains a critical unmet need for early detection of AD pathogenesis based on non-invasive neuroimaging techniques, such as magnetic resonance imaging (MRI) and positron emission tomography (PET). In this comprehensive review, we explore potential interdisciplinary approaches for early detection and provide insight into recent advances on AD classification using 3D CNN architectures for multi-modal PET/MRI data. We also consider the application of generative adversarial networks (GANs) to overcome pitfalls associated with limited data. Finally, we discuss increasing the robustness of CNNs by combining them with ensemble learning (EL).

Sign in / Sign up

Export Citation Format

Share Document