scholarly journals A Core Set Based Large Vector-Angular Region and Margin Approach for Novelty Detection

2016 ◽  
Vol 2016 ◽  
pp. 1-12 ◽  
Author(s):  
Jiusheng Chen ◽  
Xiaoyu Zhang ◽  
Kai Guo
Keyword(s):  
Large Scale ◽  
Novelty Detection ◽  
Imbalanced Data ◽  
Feature Space ◽  
Training Time ◽  
Angular Region ◽  
The Core ◽  
Large Scale Problems ◽  
Fast Training ◽  
Core Set

A large vector-angular region and margin (LARM) approach is presented for novelty detection based on imbalanced data. The key idea is to construct the largest vector-angular region in the feature space to separate normal training patterns; meanwhile, maximize the vector-angular margin between the surface of this optimal vector-angular region and abnormal training patterns. In order to improve the generalization performance of LARM, the vector-angular distribution is optimized by maximizing the vector-angular mean and minimizing the vector-angular variance, which separates the normal and abnormal examples well. However, the inherent computation of quadratic programming (QP) solver takesO(n3)training time and at leastO(n2)space, which might be computational prohibitive for large scale problems. By(1+ε)  and  (1-ε)-approximation algorithm, the core set based LARM algorithm is proposed for fast training LARM problem. Experimental results based on imbalanced datasets have validated the favorable efficiency of the proposed approach in novelty detection.

scholarly journals Learning-Based Abstractions for Nonlinear Constraint Solving

2017 ◽  
Author(s):  
Sumanth Dathathri ◽  
Nikos Arechiga ◽  
Sicun Gao ◽  
Richard M. Murray
Keyword(s):  
Large Scale ◽  
State Of The Art ◽  
Constraint Solving ◽  
Nonlinear Constraint ◽  
Abstraction Refinement ◽  
Hard Constraint ◽  
The Core ◽  
Large Scale Problems ◽  
Internal Structures ◽  
Refinement Procedure

We propose a new abstraction refinement procedure based on machine learning to improve the performance of nonlinear constraint solving algorithms on large-scale problems. The proposed approach decomposes the original set of constraints into smaller subsets, and uses learning algorithms to propose sequences of abstractions that take the form of conjunctions of classifiers. The core procedure is a refinement loop that keeps improving the learned results based on counterexamples that are obtained from partial constraints that are easy to solve. Experiments show that the proposed techniques significantly improve the performance of state-of-the-art constraint solvers on many challenging benchmarks. The mechanism is capable of producing intermediate symbolic abstractions that are also important for many applications and for understanding the internal structures of hard constraint solving problems.

scholarly journals Fast Training Logistic Regression via Adaptive Sampling

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Yunsheng Song ◽  
Xiaohan Kong ◽  
Shuoping Huang ◽  
Chao Zhang
Keyword(s):  
Logistic Regression ◽  
Random Sampling ◽  
Adaptive Sampling ◽  
Large Scale ◽  
Likelihood Function ◽  
Classification Performance ◽  
Training Data ◽  
Gradient Estimation ◽  
Training Time ◽  
Fast Training

Logistic regression has been widely used in artificial intelligence and machine learning due to its deep theoretical basis and good practical performance. Its training process aims to solve a large-scale optimization problem characterized by a likelihood function, where the gradient descent approach is the most commonly used. However, when the data size is large, it is very time-consuming because it computes the gradient using all the training data in every iteration. Though this difficulty can be solved by random sampling, the appropriate sampled examples size is difficult to be predetermined and the obtained could be not robust. To overcome this deficiency, we propose a novel algorithm for fast training logistic regression via adaptive sampling. The proposed method decomposes the problem of gradient estimation into several subproblems according to its dimension; then, each subproblem is solved independently by adaptive sampling. Each element of the gradient estimation is obtained by successively sampling a fixed volume training example multiple times until it satisfies its stopping criteria. The final estimation is combined with the results of all the subproblems. It is proved that the obtained gradient estimation is a robust estimation, and it could keep the objective function value decreasing in the iterative calculation. Compared with the representative algorithms using random sampling, the experimental results show that this algorithm obtains comparable classification performance with much less training time.

scholarly journals Shape My Face: Registering 3D Face Scans by Surface-to-Surface Translation

2021 ◽  
Author(s):  
Mehdi Bahri ◽  
Eimear O’ Sullivan ◽  
Shunwang Gong ◽  
Feng Liu ◽  
Xiaoming Liu ◽  
...  
Keyword(s):  
Large Scale ◽  
Training Time ◽  
3D Face ◽  
In The Wild ◽  
Previous State ◽  
Surface Translation ◽  
Visual Attention Mechanism ◽  
Diverse Data ◽  
Human Faces ◽  
Robust To Noise

AbstractStandard registration algorithms need to be independently applied to each surface to register, following careful pre-processing and hand-tuning. Recently, learning-based approaches have emerged that reduce the registration of new scans to running inference with a previously-trained model. The potential benefits are multifold: inference is typically orders of magnitude faster than solving a new instance of a difficult optimization problem, deep learning models can be made robust to noise and corruption, and the trained model may be re-used for other tasks, e.g. through transfer learning. In this paper, we cast the registration task as a surface-to-surface translation problem, and design a model to reliably capture the latent geometric information directly from raw 3D face scans. We introduce Shape-My-Face (SMF), a powerful encoder-decoder architecture based on an improved point cloud encoder, a novel visual attention mechanism, graph convolutional decoders with skip connections, and a specialized mouth model that we smoothly integrate with the mesh convolutions. Compared to the previous state-of-the-art learning algorithms for non-rigid registration of face scans, SMF only requires the raw data to be rigidly aligned (with scaling) with a pre-defined face template. Additionally, our model provides topologically-sound meshes with minimal supervision, offers faster training time, has orders of magnitude fewer trainable parameters, is more robust to noise, and can generalize to previously unseen datasets. We extensively evaluate the quality of our registrations on diverse data. We demonstrate the robustness and generalizability of our model with in-the-wild face scans across different modalities, sensor types, and resolutions. Finally, we show that, by learning to register scans, SMF produces a hybrid linear and non-linear morphable model. Manipulation of the latent space of SMF allows for shape generation, and morphing applications such as expression transfer in-the-wild. We train SMF on a dataset of human faces comprising 9 large-scale databases on commodity hardware.

scholarly journals Comparison of Novelty Detection Methods for Detection of Various Rotary Machinery Faults

Sensors ◽  
2021 ◽  
Vol 21 (10) ◽  
pp. 3536
Author(s):  
Jakub Górski ◽  
Adam Jabłoński ◽  
Mateusz Heesch ◽  
Michał Dziendzikowski ◽  
Ziemowit Dworakowski
Keyword(s):  
Novelty Detection ◽  
Feature Space ◽  
Detection Methods ◽  
Data Sets ◽  
Similar Distribution ◽  
Detection Algorithms ◽  
Rotary Machinery ◽  
Detection Approach ◽  
Input Reconstruction ◽  
Quantitative Indicators

Condition monitoring is an indispensable element related to the operation of rotating machinery. In this article, the monitoring system for the parallel gearbox was proposed. The novelty detection approach is used to develop the condition assessment support system, which requires data collection for a healthy structure. The measured signals were processed to extract quantitative indicators sensitive to the type of damage occurring in this type of structure. The indicator’s values were used for the development of four different novelty detection algorithms. Presented novelty detection models operate on three principles: feature space distance, probability distribution, and input reconstruction. One of the distance-based models is adaptive, adjusting to new data flowing in the form of a stream. The authors test the developed algorithms on experimental and simulation data with a similar distribution, using the training set consisting mainly of samples generated by the simulator. Presented in the article results demonstrate the effectiveness of the trained models on both data sets.

scholarly journals Investigation of Improved Cooperative Coevolution for Large-Scale Global Optimization Problems

Algorithms ◽  
2021 ◽  
Vol 14 (5) ◽  
pp. 146
Author(s):  
Aleksei Vakhnin ◽  
Evgenii Sopov
Keyword(s):  
Global Optimization ◽  
Evolutionary Algorithms ◽  
Numerical Experiments ◽  
Large Scale ◽  
Optimization Problems ◽  
State Of The Art ◽  
Fixed Number ◽  
High Dimensional ◽  
Cooperative Coevolution ◽  
Large Scale Problems

Modern real-valued optimization problems are complex and high-dimensional, and they are known as “large-scale global optimization (LSGO)” problems. Classic evolutionary algorithms (EAs) perform poorly on this class of problems because of the curse of dimensionality. Cooperative Coevolution (CC) is a high-performed framework for performing the decomposition of large-scale problems into smaller and easier subproblems by grouping objective variables. The efficiency of CC strongly depends on the size of groups and the grouping approach. In this study, an improved CC (iCC) approach for solving LSGO problems has been proposed and investigated. iCC changes the number of variables in subcomponents dynamically during the optimization process. The SHADE algorithm is used as a subcomponent optimizer. We have investigated the performance of iCC-SHADE and CC-SHADE on fifteen problems from the LSGO CEC’13 benchmark set provided by the IEEE Congress of Evolutionary Computation. The results of numerical experiments have shown that iCC-SHADE outperforms, on average, CC-SHADE with a fixed number of subcomponents. Also, we have compared iCC-SHADE with some state-of-the-art LSGO metaheuristics. The experimental results have shown that the proposed algorithm is competitive with other efficient metaheuristics.

scholarly journals A Fast and Exact Greedy Algorithm for the Core–Periphery Problem

Symmetry ◽  
2020 ◽  
Vol 12 (1) ◽  
pp. 94 ◽  
Author(s):  
Dario Fasino ◽  
Franca Rinaldi
Keyword(s):  
Structural Analysis ◽  
Optimization Problem ◽  
Polynomial Time Algorithm ◽  
Time Algorithm ◽  
Combinatorial Optimization Problem ◽  
Connected Subgraph ◽  
Optimal Solutions ◽  
The Core ◽  
Core Set ◽  
Key Concepts

The core–periphery structure is one of the key concepts in the structural analysis of complex networks. It consists of a partitioning of the node set of a given graph or network into two groups, called core and periphery, where the core nodes induce a well-connected subgraph and share connections with peripheral nodes, while the peripheral nodes are loosely connected to the core nodes and other peripheral nodes. We propose a polynomial-time algorithm to detect core–periphery structures in networks having a symmetric adjacency matrix. The core set is defined as the solution of a combinatorial optimization problem, which has a pleasant symmetry with respect to graph complementation. We provide a complete description of the optimal solutions to that problem and an exact and efficient algorithm to compute them. The proposed approach is extended to networks with loops and oriented edges. Numerical simulations are carried out on both synthetic and real-world networks to demonstrate the effectiveness and practicability of the proposed algorithm.

Fast Multipole Virtual Boundary Element - Least Square Method for Solving 2-D Elastic Problems

2011 ◽  
Vol 204-210 ◽  
pp. 2196-2201
Author(s):  
Yan Tao Jiang ◽  
Si Tian Chen ◽  
Cheng Hua Li
Keyword(s):  
Boundary Element ◽  
Large Scale ◽  
Fast Multipole Method ◽  
Main Idea ◽  
Least Square Method ◽  
Least Square ◽  
Fast Multipole ◽  
Large Scale Problems ◽  
Virtual Boundary ◽  
Virtual Boundary Element

In this paper, the fast multipole virtual boundary element - least square method (Fast Multipole VBE - LSM) is proposed and used to simulate 2-D elastic problems, which is based on the fast multipole method (FMM) and virtual boundary element - least square method (VBE - LSM).The main idea of the method is to change computational model by applying the FMM to conventional VBE - LSM. The memory and operations could be reduced to be of linear proportion to the degree of freedom (DOF) and large scale problems could be effectively solved on a common desktop with this method. Numerical results show that this method holds virtues of high feasibility, accuracy and efficiency. Moreover, the idea of this method can be generalized and extended in application.

Sign in / Sign up

Export Citation Format

Share Document