How Good Are the Bayesian Information Criterion and the Minimum Description Length Principle for Model Selection? A Bayesian Network Analysis

2006 ◽  
pp. 494-504 ◽  
Author(s):  
Nicandro Cruz-Ramírez ◽  
Héctor-Gabriel Acosta-Mesa ◽  
Rocío-Erandi Barrientos-Martínez ◽  
Luis-Alonso Nava-Fernández
Keyword(s):  
Network Analysis ◽  
Model Selection ◽  
Bayesian Network ◽  
Bayesian Information Criterion ◽  
Minimum Description Length ◽  
Information Criterion ◽  
Minimum Description Length Principle

scholarly journals Model Selection Procedures in Bounds Test of Cointegration: Theoretical Comparison and Empirical Evidence

Economies ◽  
2020 ◽  
Vol 8 (2) ◽  
pp. 49 ◽  
Author(s):  
Waqar Badshah ◽  
Mehmet Bulut
Keyword(s):  
Model Selection ◽  
Akaike Information Criterion ◽  
Bayesian Information Criterion ◽  
Selection Process ◽  
Information Criterion ◽  
Small Sample ◽  
Information Criteria ◽  
Path Model ◽  
Sample Sizes ◽  
Bounds Test

Only unstructured single-path model selection techniques, i.e., Information Criteria, are used by Bounds test of cointegration for model selection. The aim of this paper was twofold; one was to evaluate the performance of these five routinely used information criteria {Akaike Information Criterion (AIC), Akaike Information Criterion Corrected (AICC), Schwarz/Bayesian Information Criterion (SIC/BIC), Schwarz/Bayesian Information Criterion Corrected (SICC/BICC), and Hannan and Quinn Information Criterion (HQC)} and three structured approaches (Forward Selection, Backward Elimination, and Stepwise) by assessing their size and power properties at different sample sizes based on Monte Carlo simulations, and second was the assessment of the same based on real economic data. The second aim was achieved by the evaluation of the long-run relationship between three pairs of macroeconomic variables, i.e., Energy Consumption and GDP, Oil Price and GDP, and Broad Money and GDP for BRICS (Brazil, Russia, India, China and South Africa) countries using Bounds cointegration test. It was found that information criteria and structured procedures have the same powers for a sample size of 50 or greater. However, BICC and Stepwise are better at small sample sizes. In the light of simulation and real data results, a modified Bounds test with Stepwise model selection procedure may be used as it is strongly theoretically supported and avoids noise in the model selection process.

scholarly journals Using Model Selection Criteria to Choose the Number of Principal Components

2021 ◽  
Vol 20 (3) ◽  
pp. 450-461
Author(s):  
Stanley L. Sclove
Keyword(s):  
Model Selection ◽  
Principal Components ◽  
Bayesian Information Criterion ◽  
Selection Criteria ◽  
Information Criterion ◽  
Information Criteria ◽  
Akaike's Information Criterion ◽  
Model Selection Criteria ◽  
Adequate Number ◽  
Number Of Principal Components

AbstractThe use of information criteria, especially AIC (Akaike’s information criterion) and BIC (Bayesian information criterion), for choosing an adequate number of principal components is illustrated.

Time Series Forecasting by Evolutionary Neural Networks

2006 ◽  
pp. 47-70 ◽  
Author(s):  
Paulo Cortez ◽  
Miguel Rocha ◽  
José Neves
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Model Selection ◽  
Evolutionary Computation ◽  
Bayesian Information Criterion ◽  
Time Series Prediction ◽  
Information Criterion ◽  
Forecasting Methods ◽  
Search Approach ◽  
Nonlinear Learning

This chapter presents a hybrid evolutionary computation/neural network combination for time series prediction. Neural networks are innate candidates for the forecasting domain due to advantages such as nonlinear learning and noise tolerance. However, the search for the ideal network structure is a complex and crucial task. Under this context, evolutionary computation, guided by the Bayesian Information Criterion, makes a promising global search approach for feature and model selection. A set of 10 time series, from different domains, were used to evaluate this strategy, comparing it with a heuristic model selection, as well as with conventional forecasting methods (e.g., Holt-Winters & Box-Jenkins methodology).

Sign in / Sign up

Export Citation Format

Share Document