scholarly journals Colorization of Logo Sketch Based on Conditional Generative Adversarial Networks

Electronics ◽  
2021 ◽  
Vol 10 (4) ◽  
pp. 497
Author(s):  
Nannan Tian ◽  
Yuan Liu ◽  
Bo Wu ◽  
Xiaofeng Li
Keyword(s):  
Loss Function ◽  
Design Method ◽  
The Self ◽  
Generative Adversarial Networks ◽  
Model Optimization ◽  
Visual Effects ◽  
The Public ◽  
Logo Design ◽  
Adversarial Networks ◽  
Complex Process

Logo design is a complex process for designers and color plays a very important role in logo design. The automatic colorization of logo sketch is of great value and full of challenges. In this paper, we propose a new logo design method based on Conditional Generative Adversarial Networks, which can output multiple colorful logos only by providing one logo sketch. We improve the traditional U-Net structure, adding channel attention and spatial attention in the process of skip-connection. In addition, the generator consists of parallel attention-based U-Net blocks, which can output multiple logo images. During the model optimization process, a style loss function is proposed to improve the color diversity of the logos. We evaluate our method on the self-built edges2logos dataset and the public edges2shoes dataset. Experimental results show that our method can generate more colorful and realistic logo images based on simple sketches. Compared to the classic networks, the logos generated by our network are also superior in visual effects.

scholarly journals Aircraft Type Recognition in Remote Sensing Images Based on Feature Learning with Conditional Generative Adversarial Networks

2018 ◽  
Vol 10 (7) ◽  
pp. 1123 ◽  
Author(s):  
Yuhang Zhang ◽  
Hao Sun ◽  
Jiawei Zuo ◽  
Hongqi Wang ◽  
Guangluan Xu ◽  
...  
Keyword(s):  
Remote Sensing ◽  
Feature Extraction ◽  
Loss Function ◽  
Extraction Method ◽  
Generative Adversarial Networks ◽  
Support Vector ◽  
Svm Classifier ◽  
Feature Extraction Method ◽  
Adversarial Networks ◽  
Aircraft Type

Aircraft type recognition plays an important role in remote sensing image interpretation. Traditional methods suffer from bad generalization performance, while deep learning methods require large amounts of data with type labels, which are quite expensive and time-consuming to obtain. To overcome the aforementioned problems, in this paper, we propose an aircraft type recognition framework based on conditional generative adversarial networks (GANs). First, we design a new method to precisely detect aircrafts’ keypoints, which are used to generate aircraft masks and locate the positions of the aircrafts. Second, a conditional GAN with a region of interest (ROI)-weighted loss function is trained on unlabeled aircraft images and their corresponding masks. Third, an ROI feature extraction method is carefully designed to extract multi-scale features from the GAN in the regions of aircrafts. After that, a linear support vector machine (SVM) classifier is adopted to classify each sample using their features. Benefiting from the GAN, we can learn features which are strong enough to represent aircrafts based on a large unlabeled dataset. Additionally, the ROI-weighted loss function and the ROI feature extraction method make the features more related to the aircrafts rather than the background, which improves the quality of features and increases the recognition accuracy significantly. Thorough experiments were conducted on a challenging dataset, and the results prove the effectiveness of the proposed aircraft type recognition framework.

scholarly journals Best Selection of Generative Adversarial Networks Hyper-Parameters using Genetic Algorithm

2020 ◽  
Author(s):  
Fajr Alarsan ◽  
Mamoon Younes
Keyword(s):  
Genetic Algorithm ◽  
Programming Language ◽  
Loss Function ◽  
Generative Adversarial Networks ◽  
Accuracy Function ◽  
Generative Adversarial Network ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Parameters Selection ◽  
Selection Of

Abstract Generative Adversarial Networks (GANs) are most popular generative frameworks that have achieved compelling performance. They follow an adversarial approach where two deep models generator and discriminator compete with each other In this paper, we propose a Generative Adversarial Network with best hyper-parameters selection to generate fake images for digits number 1 to 9 with generator and train discriminator to decide whereas the generated images are fake or true. Using Genetic Algorithm technique to adapt GAN hyper-parameters, the final method is named GANGA:Generative Adversarial Network with Genetic Algorithm. Anaconda environment with tensorflow library facilitates was used, python as programming language also used with needed libraries. The implementation was done using MNIST dataset to validate our work. The proposed method is to let Genetic algorithm to choose best values of hyper-parameters depending on minimizing a cost function such as a loss function or maximizing accuracy function. GA was used to select values of Learning rate, Batch normalization, Number of neurons and a parameter of Dropout layer.

scholarly journals Generative Adversarial Network for Image Super-Resolution Combining Texture Loss

2020 ◽  
Vol 10 (5) ◽  
pp. 1729 ◽  
Author(s):  
Yuning Jiang ◽  
Jinhua Li
Keyword(s):  
Loss Function ◽  
Network Structure ◽  
Similarity Index ◽  
Super Resolution ◽  
Experimental Results ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Visual Evaluation ◽  
Low Frequencies ◽  
Adversarial Networks

Objective: Super-resolution reconstruction is an increasingly important area in computer vision. To alleviate the problems that super-resolution reconstruction models based on generative adversarial networks are difficult to train and contain artifacts in reconstruction results, we propose a novel and improved algorithm. Methods: This paper presented TSRGAN (Super-Resolution Generative Adversarial Networks Combining Texture Loss) model which was also based on generative adversarial networks. We redefined the generator network and discriminator network. Firstly, on the network structure, residual dense blocks without excess batch normalization layers were used to form generator network. Visual Geometry Group (VGG)19 network was adopted as the basic framework of discriminator network. Secondly, in the loss function, the weighting of the four loss functions of texture loss, perceptual loss, adversarial loss and content loss was used as the objective function of generator. Texture loss was proposed to encourage local information matching. Perceptual loss was enhanced by employing the features before activation layer to calculate. Adversarial loss was optimized based on WGAN-GP (Wasserstein GAN with Gradient Penalty) theory. Content loss was used to ensure the accuracy of low-frequency information. During the optimization process, the target image information was reconstructed from different angles of high and low frequencies. Results: The experimental results showed that our method made the average Peak Signal to Noise Ratio of reconstructed images reach 27.99 dB and the average Structural Similarity Index reach 0.778 without losing too much speed, which was superior to other comparison algorithms in objective evaluation index. What is more, TSRGAN significantly improved subjective visual evaluations such as brightness information and texture details. We found that it could generate images with more realistic textures and more accurate brightness, which were more in line with human visual evaluation. Conclusions: Our improvements to the network structure could reduce the model’s calculation amount and stabilize the training direction. In addition, the loss function we present for generator could provide stronger supervision for restoring realistic textures and achieving brightness consistency. Experimental results prove the effectiveness and superiority of TSRGAN algorithm.

scholarly journals Unified Generative Adversarial Networks for Multidomain Fingerprint Presentation Attack Detection

Entropy ◽  
2021 ◽  
Vol 23 (8) ◽  
pp. 1089
Author(s):  
Soha B. Sandouka ◽  
Yakoub Bazi ◽  
Haikel Alhichri ◽  
Naif Alajlan
Keyword(s):  
Attack Detection ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Source Domain ◽  
The Public ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Biometric Systems ◽  
Security And Reliability ◽  
Presentation Attack Detection

With the rapid growth of fingerprint-based biometric systems, it is essential to ensure the security and reliability of the deployed algorithms. Indeed, the security vulnerability of these systems has been widely recognized. Thus, it is critical to enhance the generalization ability of fingerprint presentation attack detection (PAD) cross-sensor and cross-material settings. In this work, we propose a novel solution for addressing the case of a single source domain (sensor) with large labeled real/fake fingerprint images and multiple target domains (sensors) with only few real images obtained from different sensors. Our aim is to build a model that leverages the limited sample issues in all target domains by transferring knowledge from the source domain. To this end, we train a unified generative adversarial network (UGAN) for multidomain conversion to learn several mappings between all domains. This allows us to generate additional synthetic images for the target domains from the source domain to reduce the distribution shift between fingerprint representations. Then, we train a scale compound network (EfficientNetV2) coupled with multiple head classifiers (one classifier for each domain) using the source domain and the translated images. The outputs of these classifiers are then aggregated using an additional fusion layer with learnable weights. In the experiments, we validate the proposed methodology on the public LivDet2015 dataset. The experimental results show that the proposed method improves the average classification accuracy over twelve classification scenarios from 67.80 to 80.44% after adaptation.

scholarly journals Least kth-Order and Rényi Generative Adversarial Networks

2021 ◽  
pp. 1-38
Author(s):  
Himesh Bhatia ◽  
William Paul ◽  
Fady Alajaji ◽  
Bahman Gharesifard ◽  
Philippe Burlina
Keyword(s):  
Loss Function ◽  
Degrees Of Freedom ◽  
Natural Extension ◽  
Absolute Error ◽  
Loss Functions ◽  
Generative Adversarial Networks ◽  
Data Sets ◽  
Adversarial Networks ◽  
Information Theoretic Measures ◽  
Jensen Shannon Divergence

Abstract We investigate the use of parameterized families of information-theoretic measures to generalize the loss functions of generative adversarial networks (GANs) with the objective of improving performance. A new generator loss function, least kth-order GAN (LkGAN), is introduced, generalizing the least squares GANs (LSGANs) by using a kth-order absolute error distortion measure with k≥1 (which recovers the LSGAN loss function when k=2). It is shown that minimizing this generalized loss function under an (unconstrained) optimal discriminator is equivalent to minimizing the kth-order Pearson-Vajda divergence. Another novel GAN generator loss function is next proposed in terms of Rényi cross-entropy functionals with order α>0, α≠1. It is demonstrated that this Rényi-centric generalized loss function, which provably reduces to the original GAN loss function as α→1, preserves the equilibrium point satisfied by the original GAN based on the Jensen-Rényi divergence, a natural extension of the Jensen-Shannon divergence. Experimental results indicate that the proposed loss functions, applied to the MNIST and CelebA data sets, under both DCGAN and StyleGAN architectures, confer performance benefits by virtue of the extra degrees of freedom provided by the parameters k and α, respectively. More specifically, experiments show improvements with regard to the quality of the generated images as measured by the Fréchet inception distance score and training stability. While it was applied to GANs in this study, the proposed approach is generic and can be used in other applications of information theory to deep learning, for example, the issues of fairness or privacy in artificial intelligence.

scholarly journals FLGC-Fusion GAN: An Enhanced Fusion GAN Model by Importing Fully Learnable Group Convolution

2020 ◽  
Vol 2020 ◽  
pp. 1-13 ◽  
Author(s):  
C. Yuan ◽  
C. Q. Sun ◽  
X. Y. Tang ◽  
R. F. Liu
Keyword(s):  
Generative Adversarial Networks ◽  
Visual Effects ◽  
Generative Adversarial Network ◽  
Composite Image ◽  
Adversarial Network ◽  
Adversarial Networks ◽  
Network Building ◽  
Fusion Methods ◽  
Basic Network ◽  
Public Datasets

The purpose of image fusion is to combine the source images of the same scene into a single composite image with more useful information and better visual effects. Fusion GAN has made a breakthrough in this field by proposing to use the generative adversarial network to fuse images. In some cases, considering retain infrared radiation information and gradient information at the same time, the existing fusion methods ignore the image contrast and other elements. To this end, we propose a new end-to-end network structure based on generative adversarial networks (GANs), termed as FLGC-Fusion GAN. In the generator, using the learnable grouping convolution can improve the efficiency of the model and save computing resources. Therefore, we can have a better trade-off between the accuracy and speed of the model. Besides, we take the residual dense block as the basic network building unit and use the perception characteristics of the inactive as content loss characteristics of input, achieving the effect of deep network supervision. Experimental results on two public datasets show that the proposed method performs well in subjective visual performance and objective criteria and has obvious advantages over other current typical methods.

scholarly journals Hidden Service Circuit Reconstruction Attacks Based on Middle Node Traffic Analysis

2021 ◽  
Vol 13 (6) ◽  
pp. 0-0
Keyword(s):  
Loss Function ◽  
Traffic Analysis ◽  
Generative Adversarial Networks ◽  
Identification Performance ◽  
Malicious Nodes ◽  
Adversarial Networks ◽  
Independent Determination ◽  
Middle Node ◽  
Correlated Traffic

Traffic analysis is widely considered as an attack posing a threat to anonymity of the communication and may reveal the real identity of the users. In this paper, a novel anonymous circuit reconstruction attack method that correlates the circuit traffic is proposed. This method then reconstructs a complete communication tunnel using the location of middle nodes found between the hidden and client services. The attack process includes independent determination of the location of the malicious nodes. A traffic correlation framework of AutoEncoder + CNN + BiLSTM is established, based on the Generative Adversarial Networks (GAN) model. BiLSTM applies the packet size and packet interval features of bidirectional traffic and combines the reconstruction loss function with the discrimination loss function to achieve correlated traffic evaluation. After balancing the reconstruction loss and discrimination loss scores, the simulation results confirm that the identification performance of the proposed system is higher than the advanced models.

scholarly journals Transformers and Generative Adversarial Networks for Liveness Detection in Multitarget Fingerprint Sensors

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 699
Author(s):  
Soha B. Sandouka ◽  
Yakoub Bazi ◽  
Naif Alajlan
Keyword(s):  
Attack Detection ◽  
Generative Adversarial Networks ◽  
The Public ◽  
Mobile Payments ◽  
Liveness Detection ◽  
Adversarial Networks ◽  
Biometric Systems ◽  
Financial Transactions ◽  
International Border ◽  
Material Setting

Fingerprint-based biometric systems have grown rapidly as they are used for various applications including mobile payments, international border security, and financial transactions. The widespread nature of these systems renders them vulnerable to presentation attacks. Hence, improving the generalization ability of fingerprint presentation attack detection (PAD) in cross-sensor and cross-material setting is of primary importance. In this work, we propose a solution based on a transformers and generative adversarial networks (GANs). Our aim is to reduce the distribution shift between fingerprint representations coming from multiple target sensors. In the experiments, we validate the proposed methodology on the public LivDet2015 dataset provided by the liveness detection competition. The experimental results show that the proposed architecture yields an increase in average classification accuracy from 68.52% up to 83.12% after adaptation.

scholarly journals The Novel Sensor Network Structure for Classification Processing Based on the Machine Learning Method of the ACGAN

Sensors ◽  
2019 ◽  
Vol 19 (14) ◽  
pp. 3145 ◽  
Author(s):  
Yuantao Chen ◽  
Jiajun Tao ◽  
Jin Wang ◽  
Xi Chen ◽  
Jingbo Xie ◽  
...  
Keyword(s):  
Sensor Network ◽  
Loss Function ◽  
Network Structure ◽  
Posterior Probability ◽  
Feature Matching ◽  
Generative Adversarial Networks ◽  
Classification Algorithms ◽  
The Novel ◽  
The Real ◽  
Adversarial Networks

To address the problem of unstable training and poor accuracy in image classification algorithms based on generative adversarial networks (GAN), a novel sensor network structure for classification processing using auxiliary classifier generative adversarial networks (ACGAN) is proposed in this paper. Firstly, the real/fake discrimination of sensor samples in the network has been canceled at the output layer of the discriminative network and only the posterior probability estimation of the sample tag is outputted. Secondly, by regarding the real sensor samples as supervised data and the generative sensor samples as labeled fake data, we have reconstructed the loss function of the generator and discriminator by using the real/fake attributes of sensor samples and the cross-entropy loss function of the label. Thirdly, the pooling and caching method has been introduced into the discriminator to enable more effective extraction of the classification features. Finally, feature matching has been added to the discriminative network to ensure the diversity of the generative sensor samples. Experimental results have shown that the proposed algorithm (CP-ACGAN) achieves better classification accuracy on the MNIST dataset, CIFAR10 dataset and CIFAR100 dataset than other solutions. Moreover, when compared with the ACGAN and CNN classification algorithms, which have the same deep network structure as CP-ACGAN, the proposed method continues to achieve better classification effects and stability than other main existing sensor solutions.

Sign in / Sign up

Export Citation Format

Share Document