scholarly journals Leveraging Uncertainty in Adversarial Learning to Improve Deep Learning Based Segmentation

2019 ◽  
Author(s):  
Mahed Javed ◽  
Lyudmila Mihaylova
Keyword(s):  
Deep Learning ◽  
Adversarial Learning

scholarly journals Targeted Adversarial Learning Optimized Sampling

2019 ◽  
Author(s):  
Jun Zhang ◽  
Yi Isaac Yang ◽  
Frank Noé
Keyword(s):  
Deep Learning ◽  
Optimal Transport ◽  
Dimensional Space ◽  
Optimization Techniques ◽  
Free Energy Barrier ◽  
Adversarial Learning ◽  
Bias Potential ◽  
Novel Approach ◽  
Transport Plan ◽  
Sampling Problem

<div>Boosting transitions of rare events is critical to modern-day simulations of complex dynamic systems. We present a novel approach to modify the potential energy surface in order to drive the system to a user-defined target distribution where the free energy barrier is lowered. The new approach, called targeted adversarial learning optimized sampling (TALOS), cross-fertilizes statistical mechanics and deep learning. By casting the enhanced sampling problem as a competing game between a real sampling engine and a virtual discriminator, TALOS enables unsupervised construction of bias potential on an arbitrary dimensional space and seeks for an optimal transport plan that transforms the system into target. Through multiple experiments we show that on-the-fly training of TALOS benefits from the state-of-art optimization techniques in deep learning, thus is efficient, robust and interpretable. TALOS can also simultaneously learn to extract good reaction coordinate from a high-dimensional space where bias potential is being constructed. Additionally, TALOS is shown to be closely related to reinforcement learning, giving rise to a new framework of manipulating Hamiltonian in order to fulfill user-specified tasks via deep learning.</div>

scholarly journals Learning Attention for Object Tracking with Adversarial Learning Network

2020 ◽  
Author(s):  
Xu Cheng ◽  
Chen Song ◽  
Yongxiang Gu ◽  
Beijing Chen ◽  
Lin Zhou ◽  
...  
Keyword(s):  
Deep Learning ◽  
Object Tracking ◽  
Large Scale ◽  
Fine Tuning ◽  
Object Localization ◽  
Generative Adversarial Network ◽  
Adversarial Learning ◽  
Training Time ◽  
Learning Network ◽  
Object State

Abstract Artificial intelligence has been widely studied on solving intelligent surveillance analysis and security problems in recent years. Although many multimedia security approaches have been proposed by using deep learning network model, there are still some challenges on their performances which deserve in-depth research. On one hand, high computational complexity of current deep learning methods makes it hard to be applied to real-time scenario. On the other hand, it is difficult to obtain the specific features of a video by fine-tuning the network online with the object state of the first frame, which fails to capture rich appearance variations of the object. To solve above two issues, in this paper, an effective object tracking method with learning attention is proposed to achieve the object localization and reduce the training time in adversarial learning framework. First, a prediction network is designed to track the object in video sequences. The object positions of the first ten frames are employed to fine-tune prediction network, which can fully mine a specific features of an object. Second, the prediction network is integrated into the generative adversarial network framework, which randomly generates masks to capture object appearance variations via adaptively dropout input features. Third, we present a spatial attention mechanism to improve the tracking performance. The proposed network can identify the mask that maintains the most robust features of the objects over a long temporal span. Extensive experiments on two large-scale benchmarks demonstrate that the proposed algorithm performs favorably against state-of-the-art methods.

Targeted Adversarial Learning Optimized Sampling

2019 ◽  
Author(s):  
Jun Zhang ◽  
Yi Isaac Yang ◽  
Frank Noé
Keyword(s):  
Deep Learning ◽  
Optimal Transport ◽  
Dimensional Space ◽  
Optimization Techniques ◽  
Free Energy Barrier ◽  
Adversarial Learning ◽  
New Approach ◽  
Novel Approach ◽  
Transport Plan ◽  
Sampling Problem

<div>Abstract Boosting transitions of rare events is critical to modern-day simulations of complex dynamic systems. We present a novel approach to modify the potential energy surface in order to drive the system to a user-defined target distribution where the free energy barrier is lowered. The new approach, called targeted adversarial learning optimized sampling (TALOS) combines the strengths of statistical mechanics and deep learning. By casting the enhanced sampling problem as a competing game between a real sampling engine and a virtual discriminator, TALOS enables unsupervised construction of bias potential on an arbitrary dimensional space and seeks for an optimal transport plan that transforms the system into target. Through multiple experiments we show that on-the-fly training of TALOS benefits from the state-of-art optimization techniques in deep learning, thus is efficient, robust and interpretable. Additionally, TALOS is closely connected to actor-critic reinforcement learning, giving rise to a new approach to manipulating the Hamiltonian systems via deep learning.</div>

scholarly journals Generative Adversarial Neural Architecture Search

2021 ◽  
Author(s):  
Seyed Saeed Changiz Rezaei ◽  
Fred X. Han ◽  
Di Niu ◽  
Mohammad Salameh ◽  
Keith Mills ◽  
...  
Keyword(s):  
Deep Learning ◽  
Reinforcement Learning ◽  
Importance Sampling ◽  
Ad Hoc ◽  
Search Space ◽  
Learning Approach ◽  
Adversarial Learning ◽  
Search Spaces ◽  
Neural Architecture ◽  
Empirical Success

Despite the empirical success of neural architecture search (NAS) in deep learning applications, the optimality, reproducibility and cost of NAS schemes remain hard to assess. In this paper, we propose Generative Adversarial NAS (GA-NAS) with theoretically provable convergence guarantees, promoting stability and reproducibility in neural architecture search. Inspired by importance sampling, GA-NAS iteratively fits a generator to previously discovered top architectures, thus increasingly focusing on important parts of a large search space. Furthermore, we propose an efficient adversarial learning approach, where the generator is trained by reinforcement learning based on rewards provided by a discriminator, thus being able to explore the search space without evaluating a large number of architectures. Extensive experiments show that GA-NAS beats the best published results under several cases on three public NAS benchmarks. In the meantime, GA-NAS can handle ad-hoc search constraints and search spaces. We show that GA-NAS can be used to improve already optimized baselines found by other NAS methods, including EfficientNet and ProxylessNAS, in terms of ImageNet accuracy or the number of parameters, in their original search space.

scholarly journals MACHINE LEARNING FOR APPROXIMATING UNKNOWN FACE

2020 ◽  
Vol XLIII-B2-2020 ◽  
pp. 857-862 ◽  
Author(s):  
V. A. Knyaz ◽  
V. V. Kniaz ◽  
M. M. Novikov ◽  
R. M. Galeev
Keyword(s):  
Deep Learning ◽  
3D Model ◽  
3D Models ◽  
Learning Approach ◽  
Neural Network Training ◽  
Adversarial Learning ◽  
Network Training ◽  
Learning Techniques ◽  
Facial Approximation ◽  
Automated Technique

Abstract. The problem of facial appearance reconstruction (or facial approximation) basing on a skull is very important as for anthropology and archaeology as for forensics. Recent progress in optical 3D measurements allowed to substitute manual facial reconstruction techniques with computer-aided ones based on digital skull 3D models. Growing amount of data and developing methods for data processing provide a background for creating fully automated technique of face approximation.The performed study addressed to a problem of facial approximation based on skull digital 3D model with deep learning techniques. The skull 3D models used for appearance reconstruction are generated by the original photogrammetric system in automated mode. These 3D models are then used as input for the algorithm for face appearance reconstruction. The paper presents a deep learning approach for facial approximation basing on a skull. It exploits the generative adversarial learning for transition data from one modality (skull) to another modality (face) using digital skull 3D models and face 3D models. A special dataset containing skull 3D models and face 3D models has been collected and adapted for convolutional neural network training and testing. Evaluation results on testing part of the dataset demonstrates high potential of the developed approach in facial approximation.

scholarly journals Learning Attention for Object Tracking with Adversarial Learning Network

2020 ◽  
Author(s):  
Xu Cheng ◽  
Chen Song ◽  
Yongxiang Gu ◽  
Beijing Chen
Keyword(s):  
Deep Learning ◽  
Object Tracking ◽  
Large Scale ◽  
Fine Tuning ◽  
Object Localization ◽  
Generative Adversarial Network ◽  
Adversarial Learning ◽  
Training Time ◽  
Learning Network ◽  
Object State

Abstract Artificial intelligence has been widely studied on solving intelligent surveillance analysis and security problems in recent years. Although many multimedia security approaches have been proposed by using deep learning network model, there are still some challenges on their performances which deserve in-depth research. On one hand, high computational complexity of current deep learning methods makes it hard to be applied to real-time scenario. On the other hand, it is difficult to obtain the specific features of a video by fine-tuning the network online with the object state of the first frame, which fails to capture rich appearance variations of the object. To solve above two issues, in this paper, an effective object tracking method with learning attention is proposed to achieve the object localization and reduce the training time in adversarial learning framework. First, a prediction network is designed to track the object in video sequences. The object positions of the first ten frames are employed to fine-tune prediction network, which can fully mine a specific features of an object. Second, the prediction network is integrated into the generative adversarial network framework, which randomly generates masks to capture object appearance variations via adaptively dropout input features. Third, we present a spatial attention mechanism to improve the tracking performance. The proposed network can identify the mask that maintains the most robust features of the objects over a long temporal span. Extensive experiments on two large-scale benchmarks demonstrate that the proposed algorithm performs favorably against state-of-the-art methods.

scholarly journals Learning Attention for Object Tracking with Adversarial Learning Network

2020 ◽  
Author(s):  
Xu Cheng ◽  
Chen Song ◽  
Yongxiang Gu ◽  
Beijing Chen
Keyword(s):  
Deep Learning ◽  
Object Tracking ◽  
Large Scale ◽  
Fine Tuning ◽  
Object Localization ◽  
Generative Adversarial Network ◽  
Adversarial Learning ◽  
Training Time ◽  
Learning Network ◽  
Object State

Abstract Artificial intelligence has been widely studied on solving intelligent surveillance analysis and security problems in recent years. Although many multimedia security approaches have been proposed by using deep learning network model, there are still some challenges on their performances which deserve in-depth research. On one hand, high computational complexity of current deep learning methods makes it hard to be applied to real-time scenario. On the other hand, it is difficult to obtain the specific features of a video by fine-tuning the network online with the object state of the first frame, which fails to capture rich appearance variations of the object. To solve above two issues, in this paper, an effective object tracking method with learning attention is proposed to achieve the object localization and reduce the training time in adversarial learning framework. First, a prediction network is designed to track the object in video sequences. The object positions of the first ten frames are employed to fine-tune prediction network, which can fully mine a specific features of an object. Second, the prediction network is integrated into the generative adversarial network framework, which randomly generates masks to capture object appearance variations via adaptively dropout input features. Third, we present a spatial attention mechanism to improve the tracking performance. The proposed network can identify the mask that maintains the most robust features of the objects over a long temporal span. Extensive experiments on two large-scale benchmarks demonstrate that the proposed algorithm performs favorably against state-of-the-art methods.

scholarly journals Towards Reliable Learning for High Stakes Applications

2019 ◽  
Vol 33 ◽  
pp. 3614-3621
Author(s):  
Jinyang Gao ◽  
Junjie Yao ◽  
Yingxia Shao
Keyword(s):  
Computer Vision ◽  
Deep Learning ◽  
Clinical Diagnosis ◽  
Error Rate ◽  
Correct Answer ◽  
High Stakes ◽  
Adversarial Learning ◽  
Generalization Performance ◽  
Financial Investment ◽  
The Real

In this paper, we focus on delivering reliable learning results for high stakes applications such as self-driving, financial investment and clinical diagnosis, where the accuracy of predictions is considered as a more crucial requirement than giving predictions for all query samples. We adopt the learning with reject option framework where the learning model only predict those samples which they convince to give the correct answer. However, for most prevailing deep learning predictors, the confidence estimated by the model themselves are far from reflecting the real generalization performance. To model the reliability of prediction concisely, we propose an exploratory solution called GALVE (Generative Adversarial Learning with Variance Expansion) which adopts generative adversarial learning to implicitly measure the region where the model achieve good generalization performance. By applying GALVE to measure the reliability of predictions, we achieved an error rate less than half of which straightforwardly measured by confidence in CIFAR10 and SVHN computer vision tasks.

Sign in / Sign up

Export Citation Format

Share Document