Geometry Aware Constrained Optimization Techniques for Deep Learning

Author(s):  
Soumava Kumar Roy ◽  
Zakaria Mhammedi ◽  
Mehrtash Harandi
2020 ◽  
pp. 1826-1838
Author(s):  
Rojalina Priyadarshini ◽  
Rabindra K. Barik ◽  
Chhabi Panigrahi ◽  
Harishchandra Dubey ◽  
Brojo Kishore Mishra

This article describes how machine learning (ML) algorithms are very useful for analysis of data and finding some meaningful information out of them, which could be used in various other applications. In the last few years, an explosive growth has been seen in the dimension and structure of data. There are several difficulties faced by conventional ML algorithms while dealing with such highly voluminous and unstructured big data. The modern ML tools are designed and used to deal with all sorts of complexities of data. Deep learning (DL) is one of the modern ML tools which are commonly used to find the hidden structure and cohesion among these large data sets by giving proper training in parallel platforms with intelligent optimization techniques to further analyze and interpret the data for future prediction and classification. This article focuses on the use of DL tools and software which are used in past couple of years in various areas and especially in the area of healthcare applications.


Machines ◽  
2020 ◽  
Vol 8 (3) ◽  
pp. 49
Author(s):  
Anna Boschi ◽  
Francesco Salvetti ◽  
Vittorio Mazzia ◽  
Marcello Chiaberge

The vital statistics of the last century highlight a sharp increment of the average age of the world population with a consequent growth of the number of older people. Service robotics applications have the potentiality to provide systems and tools to support the autonomous and self-sufficient older adults in their houses in everyday life, thereby avoiding the task of monitoring them with third parties. In this context, we propose a cost-effective modular solution to detect and follow a person in an indoor, domestic environment. We exploited the latest advancements in deep learning optimization techniques, and we compared different neural network accelerators to provide a robust and flexible person-following system at the edge. Our proposed cost-effective and power-efficient solution is fully-integrable with pre-existing navigation stacks and creates the foundations for the development of fully-autonomous and self-contained service robotics applications.


2018 ◽  
Vol 108 ◽  
pp. 509-526 ◽  
Author(s):  
Mahmoud Ismail ◽  
Mina Attari ◽  
Saeid Habibi ◽  
Samir Ziada

2021 ◽  
Author(s):  
Abul Abrar Masrur Ahmed ◽  
Mohammad Hafez Ahmed ◽  
Sanjoy Kanti Saha ◽  
Oli Ahmed ◽  
Ambica Sutradhar

Abstract The solar ultraviolet index (UVI) is a key public health indicator to mitigate the ultraviolet-exposure related diseases. However, in practice, the ultraviolet irradiance measurements are difficult and need expensive ground-based physical models and time-consuming satellite-observed data. Furthermore, accurate short-term forecasting is crucial for making effective decisions on public health owing to UVI related diseases. To this end, this study aimed to develop and compare the performances of different hybridized deep learning models for forecasting the daily UVI index. The ultraviolet irradiance-related data were collected for Perth station of Western Australia. A hybrid-deep learning framework was formulated with a convolutional neural network and long short-term memory called CLSTM. The comprehensive dataset (i.e., satellite-derived Moderate Resolution Imaging Spectroradiometer, ground-based datasets from Scientific Information for Landowners, and synoptic-scale climate indices) were fed into the proposed network and optimized by four optimization techniques. The results demonstrated the excellent forecasting capability (i.e., low error and high efficiency) of the recommended hybrid CLSTM model compared to the counterpart benchmark models. Overall, this study showed that the proposed hybrid CLSTM model successfully apprehends the complex and non-linear relationships between predictor variables and the daily UVI. A complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN)-CLSTM-based is appeared to be an accurate forecasting system capable of reacting quickly to measured conditions. Further, the genetic algorithm is found to be the most effective optimization technique. The study inference can considerably enhance real-time exposure advice for the public and help mitigate the potential for solar UV-exposure-related diseases such as melanoma.


2019 ◽  
Author(s):  
Jun Zhang ◽  
Yi Isaac Yang ◽  
Frank Noé

<div>Boosting transitions of rare events is critical to modern-day simulations of complex dynamic systems. We present a novel approach to modify the potential energy surface in order to drive the system to a user-defined target distribution where the free energy barrier is lowered. The new approach, called targeted adversarial learning optimized sampling (TALOS), cross-fertilizes statistical mechanics and deep learning. By casting the enhanced sampling problem as a competing game between a real sampling engine and a virtual discriminator, TALOS enables unsupervised construction of bias potential on an arbitrary dimensional space and seeks for an optimal transport plan that transforms the system into target. Through multiple experiments we show that on-the-fly training of TALOS benefits from the state-of-art optimization techniques in deep learning, thus is efficient, robust and interpretable. TALOS can also simultaneously learn to extract good reaction coordinate from a high-dimensional space where bias potential is being constructed. Additionally, TALOS is shown to be closely related to reinforcement learning, giving rise to a new framework of manipulating Hamiltonian in order to fulfill user-specified tasks via deep learning.</div>


2020 ◽  
Vol 34 (04) ◽  
pp. 5248-5255
Author(s):  
Harikrishna Narasimhan ◽  
Andrew Cotter ◽  
Maya Gupta ◽  
Serena Wang

We present pairwise fairness metrics for ranking models and regression models that form analogues of statistical fairness notions such as equal opportunity, equal accuracy, and statistical parity. Our pairwise formulation supports both discrete protected groups, and continuous protected attributes. We show that the resulting training problems can be efficiently and effectively solved using existing constrained optimization and robust optimization techniques developed for fair classification. Experiments illustrate the broad applicability and trade-offs of these methods.


Sign in / Sign up

Export Citation Format

Share Document