scholarly journals High dimensional Kriging metamodelling utilising gradient information

2016 ◽  
Vol 40 (9-10) ◽  
pp. 5256-5270 ◽  
Author(s):  
S. Ulaganathan ◽  
I. Couckuyt ◽  
T. Dhaene ◽  
J. Degroote ◽  
E. Laermans
Keyword(s):  
High Dimensional ◽  
Gradient Information

scholarly journals Deep Active Subspaces: A Scalable Method for High-Dimensional Uncertainty Propagation

2019 ◽  
Author(s):  
Rohit Tripathy ◽  
Ilias Bilionis
Keyword(s):  
Dimensionality Reduction ◽  
Stochastic Systems ◽  
Uncertainty Propagation ◽  
Gaussian Process Regression ◽  
Surrogate Modeling ◽  
Forward Model ◽  
High Dimensional ◽  
Great Promise ◽  
Gradient Information ◽  
Active Subspaces

Abstract A problem of considerable importance within the field of uncertainty quantification (UQ) is the development of efficient methods for the construction of accurate surrogate models. Such efforts are particularly important to applications constrained by high-dimensional uncertain parameter spaces. The difficulty of accurate surrogate modeling in such systems, is further compounded by data scarcity brought about by the large cost of forward model evaluations. Traditional response surface techniques, such as Gaussian process regression (or Kriging) and polynomial chaos are difficult to scale to high dimensions. To make surrogate modeling tractable in expensive high-dimensional systems, one must resort to dimensionality reduction of the stochastic parameter space. A recent dimensionality reduction technique that has shown great promise is the method of ‘active subspaces’. The classical formulation of active subspaces, unfortunately, requires gradient information from the forward model — often impossible to obtain. In this work, we present a simple, scalable method for recovering active subspaces in high-dimensional stochastic systems, without gradient-information that relies on a reparameterization of the orthogonal active subspace projection matrix, and couple this formulation with deep neural networks. We demonstrate our approach on challenging synthetic datasets and show favorable predictive comparison to classical active subspaces.

Preface to the special issue, CMAM 2011, no. 3.

2011 ◽  
Vol 11 (3) ◽  
pp. 272
Author(s):  
Ivan Gavrilyuk ◽  
Boris Khoromskij ◽  
Eugene Tyrtyshnikov
Keyword(s):  
Separation Of Variables ◽  
Numerical Algorithms ◽  
Multilevel Methods ◽  
High Dimensional ◽  
Special Issue ◽  
High Dimensions ◽  
Guiding Principle ◽  
Tensor Methods ◽  
Closed World ◽  
The One

Abstract In the recent years, multidimensional numerical simulations with tensor-structured data formats have been recognized as the basic concept for breaking the "curse of dimensionality". Modern applications of tensor methods include the challenging high-dimensional problems of material sciences, bio-science, stochastic modeling, signal processing, machine learning, and data mining, financial mathematics, etc. The guiding principle of the tensor methods is an approximation of multivariate functions and operators with some separation of variables to keep the computational process in a low parametric tensor-structured manifold. Tensors structures had been wildly used as models of data and discussed in the contexts of differential geometry, mechanics, algebraic geometry, data analysis etc. before tensor methods recently have penetrated into numerical computations. On the one hand, the existing tensor representation formats remained to be of a limited use in many high-dimensional problems because of lack of sufficiently reliable and fast software. On the other hand, for moderate dimensional problems (e.g. in "ab-initio" quantum chemistry) as well as for selected model problems of very high dimensions, the application of traditional canonical and Tucker formats in combination with the ideas of multilevel methods has led to the new efficient algorithms. The recent progress in tensor numerical methods is achieved with new representation formats now known as "tensor-train representations" and "hierarchical Tucker representations". Note that the formats themselves could have been picked up earlier in the literature on the modeling of quantum systems. Until 2009 they lived in a closed world of those quantum theory publications and never trespassed the territory of numerical analysis. The tremendous progress during the very recent years shows the new tensor tools in various applications and in the development of these tools and study of their approximation and algebraic properties. This special issue treats tensors as a base for efficient numerical algorithms in various modern applications and with special emphases on the new representation formats.

Sign in / Sign up

Export Citation Format

Share Document