Automatic Tuning Technique Exploring Within the Hardware-Specific Constrained Parameters

2006 ◽  
pp. 413-421
Author(s):  
Toshiyuki Imamura ◽  
Ken Naono
Keyword(s):  
Automatic Tuning

Automatic tuning and adaptation for PID controllers - a survey

1993 ◽  
Vol 1 (4) ◽  
pp. 699-714 ◽  
Author(s):  
K.J. Åström ◽  
T. Hägglund ◽  
C.C. Hang ◽  
W.K. Ho
Keyword(s):  
Automatic Tuning ◽  
Pid Controllers

scholarly journals Optimization based Layer-wise Magnitude-based Pruning for DNN Compression

2018 ◽  
Author(s):  
Guiying Li ◽  
Chao Qian ◽  
Chunhui Jiang ◽  
Xiaofen Lu ◽  
Ke Tang
Keyword(s):  
Deep Neural Network ◽  
Optimization Problem ◽  
State Of The Art ◽  
Automatic Tuning ◽  
Constrained Optimization Problem ◽  
Derivative Free Optimization ◽  
Derivative Free ◽  
Threshold Tuning ◽  
Model Subject ◽  
Pruning Methods

Layer-wise magnitude-based pruning (LMP) is a very popular method for deep neural network (DNN) compression. However, tuning the layer-specific thresholds is a difficult task, since the space of threshold candidates is exponentially large and the evaluation is very expensive. Previous methods are mainly by hand and require expertise. In this paper, we propose an automatic tuning approach based on optimization, named OLMP. The idea is to transform the threshold tuning problem into a constrained optimization problem (i.e., minimizing the size of the pruned model subject to a constraint on the accuracy loss), and then use powerful derivative-free optimization algorithms to solve it. To compress a trained DNN, OLMP is conducted within a new iterative pruning and adjusting pipeline. Empirical results show that OLMP can achieve the best pruning ratio on LeNet-style models (i.e., 114 times for LeNet-300-100 and 298 times for LeNet-5) compared with some state-of-the- art DNN pruning methods, and can reduce the size of an AlexNet-style network up to 82 times without accuracy loss.

Automatic tuning of decentralized PID controllers for TITO processes

Automatica ◽  
1995 ◽  
Vol 31 (7) ◽  
pp. 1001-1010 ◽  
Author(s):  
Z.J. Palmor ◽  
Y. Halevi ◽  
N. Krasney
Keyword(s):  
Automatic Tuning ◽  
Pid Controllers
Sign in / Sign up

Export Citation Format

Share Document