scholarly journals Is Second-Order Information Helpful for Large-Scale Visual Recognition?

2017 ◽  
Author(s):  
Peihua Li ◽  
Jiangtao Xie ◽  
Qilong Wang ◽  
Wangmeng Zuo
Keyword(s):  
Large Scale ◽  
Visual Recognition ◽  
Second Order ◽  
Order Information

Behavior Models of Voltage Differencing Inverting Buffered Amplifier and Applications in Circuit Analysis

2019 ◽  
Vol 12 (4) ◽  
pp. 298-303
Author(s):  
YongAn LI
Keyword(s):  
Large Scale ◽  
Vlsi Design ◽  
Circuit Analysis ◽  
Second Order ◽  
Very Large Scale Integration ◽  
Behavioral Models ◽  
Order Filter ◽  
Large Scale Integration ◽  
Scale Integration ◽  
Behavior Models

Background: The symbolic nodal analysis acts as a pivotal part of the very large scale integration (VLSI) design. Methods: In this work, based on the terminal relations for the pathological elements and the voltage differencing inverting buffered amplifier (VDIBA), twelve alternative pathological models for the VDIBA are presented. Moreover, the proposed models are applied to the VDIBA-based second-order filter and oscillator so as to simplify the circuit analysis. Results: The result shows that the behavioral models for the VDIBA are systematic, effective and powerful in the symbolic nodal circuit analysis.</P>

scholarly journals Higher order Hamiltonian Monte Carlo sampling for cosmological large-scale structure analysis

2021 ◽  
Vol 502 (3) ◽  
pp. 3976-3992
Author(s):  
Mónica Hernández-Sánchez ◽  
Francisco-Shu Kitaura ◽  
Metin Ata ◽  
Claudio Dalla Vecchia
Keyword(s):  
Fourth Order ◽  
Large Scale ◽  
Equations Of Motion ◽  
Large Scale Structure ◽  
Real Space ◽  
Higher Order ◽  
Second Order ◽  
Scale Structure ◽  
Integration Schemes ◽  
Reconstruction Methods

ABSTRACT We investigate higher order symplectic integration strategies within Bayesian cosmic density field reconstruction methods. In particular, we study the fourth-order discretization of Hamiltonian equations of motion (EoM). This is achieved by recursively applying the basic second-order leap-frog scheme (considering the single evaluation of the EoM) in a combination of even numbers of forward time integration steps with a single intermediate backward step. This largely reduces the number of evaluations and random gradient computations, as required in the usual second-order case for high-dimensional cases. We restrict this study to the lognormal-Poisson model, applied to a full volume halo catalogue in real space on a cubical mesh of 1250 h−1 Mpc side and 2563 cells. Hence, we neglect selection effects, redshift space distortions, and displacements. We note that those observational and cosmic evolution effects can be accounted for in subsequent Gibbs-sampling steps within the COSMIC BIRTH algorithm. We find that going from the usual second to fourth order in the leap-frog scheme shortens the burn-in phase by a factor of at least ∼30. This implies that 75–90 independent samples are obtained while the fastest second-order method converges. After convergence, the correlation lengths indicate an improvement factor of about 3.0 fewer gradient computations for meshes of 2563 cells. In the considered cosmological scenario, the traditional leap-frog scheme turns out to outperform higher order integration schemes only when considering lower dimensional problems, e.g. meshes with 643 cells. This gain in computational efficiency can help to go towards a full Bayesian analysis of the cosmological large-scale structure for upcoming galaxy surveys.

scholarly journals Meta-Descent for Online, Continual Prediction

2019 ◽  
Vol 33 ◽  
pp. 3943-3950
Author(s):  
Andrew Jacobsen ◽  
Matthew Schlegel ◽  
Cameron Linke ◽  
Thomas Degris ◽  
Adam White ◽  
...  
Keyword(s):  
Gradient Descent ◽  
Large Scale ◽  
Time Series Prediction ◽  
Real Data ◽  
Second Order ◽  
Stochastic Gradient Descent ◽  
Step Size ◽  
Vector Approximation ◽  
Prediction Problems ◽  
Stationary Problems

This paper investigates different vector step-size adaptation approaches for non-stationary online, continual prediction problems. Vanilla stochastic gradient descent can be considerably improved by scaling the update with a vector of appropriately chosen step-sizes. Many methods, including AdaGrad, RMSProp, and AMSGrad, keep statistics about the learning process to approximate a second order update—a vector approximation of the inverse Hessian. Another family of approaches use meta-gradient descent to adapt the stepsize parameters to minimize prediction error. These metadescent strategies are promising for non-stationary problems, but have not been as extensively explored as quasi-second order methods. We first derive a general, incremental metadescent algorithm, called AdaGain, designed to be applicable to a much broader range of algorithms, including those with semi-gradient updates or even those with accelerations, such as RMSProp. We provide an empirical comparison of methods from both families. We conclude that methods from both families can perform well, but in non-stationary prediction problems the meta-descent methods exhibit advantages. Our method is particularly robust across several prediction problems, and is competitive with the state-of-the-art method on a large-scale, time-series prediction problem on real data from a mobile robot.

scholarly journals HD-MTL: Hierarchical Deep Multi-Task Learning for Large-Scale Visual Recognition

2017 ◽  
Vol 26 (4) ◽  
pp. 1923-1938 ◽  
Author(s):  
Jianping Fan ◽  
Tianyi Zhao ◽  
Zhenzhong Kuang ◽  
Yu Zheng ◽  
Ji Zhang ◽  
...  
Keyword(s):  
Large Scale ◽  
Visual Recognition ◽  
Task Learning

scholarly journals Reliability of a Visual Recognition System for Detection of Johnsongrass(Sorghum halepense) in Corn

2011 ◽  
Vol 25 (4) ◽  
pp. 645-651 ◽  
Author(s):  
Dionisio Andújar ◽  
Ángela Ribeiro ◽  
Cesar Fernández-Quintanilla ◽  
José Dorado
Keyword(s):  
Large Scale ◽  
Visual Recognition ◽  
Visual Detection ◽  
Cropping Systems ◽  
Experimental Period ◽  
Recognition System ◽  
Infested Area ◽  
Net Returns ◽  
Cropping Season ◽  
Combine Harvester

The feasibility of visual detection of weeds for map-based patch spraying systems needs to be assessed for use in large-scale cropping systems. The main objective of this research was to evaluate the reliability and profitability of using maps of Johnsongrass patches constructed at harvest to predict spatial distribution of weeds during the next cropping season. Johnsongrass patches visually were assessed from the cabin of a combine harvester in three corn fields and were compared with maps obtained in the subsequent year prior to postemergence herbicide application. There was a good correlation (71% on average) between the position of Johnsongrass patches on the two maps (fall vs. spring). The highest correlation (82%) was obtained with relatively large infestations, whereas the lowest (58%) was obtained when the infested area was smaller. Although the relative positions of the patches remained almost unchanged from 1 yr to the next, the infested area increased in all fields during the 4-yr experimental period. According to our estimates, using a strategy based on spraying full rates of herbicides to patches recorded in the map generated in the previous fall resulted in higher net returns than spraying the whole field, either at full or half rate. This site-specific strategy resulted in an average 65% reduction in the volume of herbicide applied to control this weed.

A Large Scale Cross-Validation of Second-Order Personality Structure Defined by the 16PF

1986 ◽  
Vol 59 (2) ◽  
pp. 683-693 ◽  
Author(s):  
Samuel E. Krug ◽  
Edgar F. Johns
Keyword(s):  
Large Scale ◽  
Common Factor ◽  
Geographic Location ◽  
Second Order ◽  
Personality Factor ◽  
Personality Factor Questionnaire ◽  
Normal Males ◽  
Definition Of ◽  
High Degree ◽  
Factor Estimation

The second-order factors structure of the 16 Personality Factor Questionnaire (16PF) was cross-validated on a large sample ( N = 17,381) of normal males and females. Subjects were sampled across a broad range of ages, socioeconomic levels, education, geographic location, and ethnicity. The purposes of this investigation were (1) to provide a precise definition of 16PF second-order factor structure, (2) to shed additional light on the nature of two second-order factors that have been previously identified but described as “unstable” and “poorly reproduced,” and (3) to determine the extent to which common factor estimation formulas for men and women would prove satisfactory for applied work. The resulting solutions were congruent with previous studies and showed a high degree of simple structure. Support was provided for one, but not both, of the two additional second-order factors. Results also supported the use of simplified estimation formulas for applied use.

scholarly journals Image Classification Using Transfer Learning and Deep Learning

2021 ◽  
Vol 10 (9) ◽  
pp. 25394-25398
Author(s):  
Chitra Desai
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Image Classification ◽  
Transfer Learning ◽  
Network Model ◽  
Neural Network Model ◽  
Large Scale ◽  
Deep Neural Network ◽  
Visual Recognition ◽  
Classification Of Images

Deep learning models have demonstrated improved efficacy in image classification since the ImageNet Large Scale Visual Recognition Challenge started since 2010. Classification of images has further augmented in the field of computer vision with the dawn of transfer learning. To train a model on huge dataset demands huge computational resources and add a lot of cost to learning. Transfer learning allows to reduce on cost of learning and also help avoid reinventing the wheel. There are several pretrained models like VGG16, VGG19, ResNet50, Inceptionv3, EfficientNet etc which are widely used.   This paper demonstrates image classification using pretrained deep neural network model VGG16 which is trained on images from ImageNet dataset. After obtaining the convolutional base model, a new deep neural network model is built on top of it for image classification based on fully connected network. This classifier will use features extracted from the convolutional base model.

Sign in / Sign up

Export Citation Format

Share Document