Bayesian Inference in Dynamic Econometric Models

✍ Scribed by Luc Bauwens, Michel Lubrano, Jean Francois Richard

• Publisher: OUP Oxford
• Year: 2000
• Tongue: English
• Leaves: 370
• Series: Advanced Texts in Econometrics
• Category: Library

✦ Synopsis

This book contains an up-to-date coverage of the last twenty years advances in Bayesian inference in econometrics, with an emphasis on dynamic models. It shows how to treat Bayesian inference in non linear models, by integrating the useful developments of numerical integration techniques based on simulations (such as Markov Chain Monte Carlo methods), and the long available analytical results of Bayesian inference for linear regression models. It thus covers a broad range of rather recent models for economic time series, such as non linear models, autoregressive conditional heteroskedastic regressions, and cointegrated vector autoregressive models. It contains also an extensive chapter on unit root inference from the Bayesian viewpoint. Several examples illustrate the methods.

✦ Table of Contents

Cover
Title Pages
Foreword
Preface
1: Decision Theory and Bayesian Inference
Abstract and Keywords
1.1 Introduction
1.2 The Baseline Decision Problem
1.3 The Moral Expectation Theorem
1.4 The Interpretation of Probabilities
1.5 Factorizations of Π: Bayes' Theorem
1.6 Extensive Form Analysis
1.7 Normal or Strategic Form Analysis
1.8 Statistical Inference and Scientific Reporting
1.9 Estimation
1.10 Hypothesis Testing
1.10.1 Introduction
1.10.2 Classical Hypothesis Testing
1.10.2.1 Classical Confidence Regions
1.10.3 Bayesian Hypothesis Testing
1.10.3.1 Bayesian Confidence Regions
1.10.4 An Example
1.10.4.1 Classical Procedures
1.10.4.2 Bayesian Procedures
2: Bayesian Statistics and Linear Regression
Abstract and Keywords
2.1 Introduction
2.2 The Likelihood Principle
2.2.1 Definition
2.2.2 Nuisance Parameters
2.2.3 Stopping Rules
2.2.4 Identification
2.3 Density and Likelihood Kernels
2.4 Sufficient Statistics
2.4.1 Definition
2.4.2 The Exponential Family
2.5 Natural Conjugate Inference
2.5.1 General Principle
2.5.2 Inference in the Multivariate Normal Process
2.6 Reductions of Models
2.6.1 Reduction by Conditioning and Exogeneity
2.6.2 Conditioning and the Regression Model
2.7 Inference in the Linear Regression Model
2.7.1 Model and Likelihood Function
2.7.2 Natural Conjugate Prior Density
2.7.3 Posterior Densities
2.7.4 Predictive Densities
3: Methods of Numerical Integration
Abstract and Keywords
3.1 Introduction
3.2 General Principle for Partially Linear Models
3.3 Deterministic Integration Methods
3.3.1 Simpson's Rules
3.3.1.1 Applications of Simpson's rules in econometrics
3.3.2 Other Rules
3.3.2.1 Trapezoidal Rule
3.3.2.2 Gauss Rules
3.3.2.3 Laplace Approximations
3.4 Monte Carlo Methods
3.4.1 Direct Sampling
3.4.1.1 Antithetic Acceleration
3.4.1.2 Applications of Direct Sampling in Econometrics
3.4.2 Importance Sampling
3.4.2.1 Properties of gi as an Estimator of μG
3.4.2.2 Practical Hints about Convergence
3.4.2.3 General Criteria for Choosing an Importance Function
3.4.2.4 Methods for Choosing an Importance Function
3.4.2.5 Rejection Sampling
3.4.2.6 Applications of Importance Sampling in Econometrics
3.4.3 Markov Chain Methods
3.4.3.1 Gibbs Sampling
3.4.3.2 Griddy-Gibbs Sampling
3.4.3.3 Metropolis-Hastings Algorithm
3.4.3.4 Convergence Criteria for MCMC Methods
3.4.3.5 Applications of MCMC Methods in Econometrics
3.5 Conclusion
4: Prior Densities for the Regression Model
Abstract and Keywords
4.1 Introduction
4.2 The Elicitation of a Prior Density
4.2.1 Distributions Adjusted on Historical Data
4.2.2 Subjective Prior Information: a Discussion
4.2.3 The Interval Betting Method for Regression Parameters
4.2.3.1 The Inverted Gamma-2 Prior
4.2.3.2 The Marginal Student Prior of β
4.2.4 The Predictive Method
4.2.5 Simplifications for Assigning Prior Covariances
4.3 The Quantification of Ignorance
4.3.1 Ancient Justifications for Ignorance Priors
4.3.2 Modern Justifications for Ignorance Priors
4.3.3 Stable Inference
4.3.4 Jeffreys' Invariance Principle
4.3.5 Non-informative Limit of a Natural Conjugate Prior
4.3.6 The Reference Prior
4.4 Restrictive Properties of the NIG Prior
4.4.1 Diffuse Prior on σ2 and Informative Prior on β
4.4.2 Conflicting Information
4.5 Student Prior and Poly-t Densities
4.5.1 Pooling Two Independent Samples
4.5.2 Student Prior
4.5.3 A Wage Equation for Belgium
4.6 Special Topics
4.6.1 Exact Restrictions
4.6.2 Exchangeable Priors
5: Dynamic Regression Models
Abstract and Keywords
5.1 Introduction
5.2 Statistical Issues Specific to Dynamic Models
5.2.1 Reductions: Exogeneity and Causality
5.2.2 Reduction of a VAR Model to an ADL Equation
5.2.3 Treatment of Initial Observations
5.2.4 Non-stationarity
5.3 Inference in ADL Models
5.3.1 Model Specification and Posterior Analysis
5.3.2 Truncation to the Stationarity Region
5.3.3 Predictive Analysis
5.3.4 Inference on Long-run Multipliers
5.4 Models with AR Errors
5.4.1 Common Factor Restrictions in ADL Models
5.4.2 Bayesian Inference
5.4.3 Testing for Common Factors and Autocorrelation
5.5 Models with ARMA Errors
5.5.1 Identification Problems
5.5.2 The Likelihood Function
5.5.3 Bayesian Inference
5.6 Money Demand in Belgium
6: Unit Root Inference
Abstract and Keywords
6.1 Introduction
6.2 Controversies in the Literature
6.2.1 The Helicopter Tour
6.2.2 Bayesian Routes to Unit Root Testing
6.2.3 What Is Important?
6.3 Dynamic Properties of the AR (1) Model
6.3.1 Initial Condition
6.3.2 Introducing a Constant and a Trend
6.3.3 Trend and Cycle Decomposition
6.4 Pathologies in the Likelihood Functions
6.4.1 Definitions
6.4.2 The Simple AR (1) Model
6.4.3 The Non-linear AR (1) Model with Constant
6.4.4 The Linear AR (1) Model with Constant
6.4.5 Summary
6.5 The Exact Role of Jeffreys' Prior
6.5.1 Jeffreys' Prior Without Deterministic Terms
6.5.2 Choosing a Prior for the Simple AR (1) Model
6.5.3 Jeffreys' prior with Deterministic Terms
6.5.4 Playing with Singularities
6.5.5 Bayesian Unit Root Testing
6.5.6 Can We Test for a Unit Root Using a Linear Model?
6.6 Analysing the Extended Nelson–Plosser Data
6.6.1 The AR(p) Model with a Deterministic Trend
6.6.2 The Empirical Results
6.7 Conclusion
6.8 Appendix: Jeffreys' Prior with the Exact Likelihood
7: Heteroscedasticity and ARCH
Abstract and Keywords
7.1 Introduction
7.2 Functional Heteroscedasticity
7.2.1 Prior Density and Likelihood Function
7.2.2 Posterior Analysis
7.2.3 A Test of Homoscedasticity
7.2.4 Application to Electricity Consumption
7.3 ARCH Models
7.3.1 Introduction
7.3.2 Properties of ARCH Processes
7.3.3 Likelihood Function and Posterior Density
7.3.4 Predictive Densities
7.3.5 Application to the USD/DM Exchange Rate
7.3.6 Regression Models with ARCH Errors
7.4 GARCH Models
7.4.1 Properties of GARCH Processes
7.4.2 Extensions of GARCH Processes
7.4.3 Inference in GARCH Processes
7.4.4 Application to the USD/DM Exchange Rate
7.5 Stationarity and Persistence
7.5.1 Stationarity
7.5.2 Measures of Persistence
7.5.3 Application to the USD/DM Exchange Rate
7.6 Bayesian Heteroscedasticity Diagnostic
7.6.1 Properties of Bayesian Residuals
7.6.2 A Diagnostic Procedure
7.6.3 Applications to Electricity and Exchange Rate Data Sets
7.7 Conclusion
8: Non-Linear Time Series Models
Abstract and Keywords
8.1 Introduction
8.2 Inference in Threshold Regression Models
8.2.1 A Typology of Threshold Models
8.2.2 Notation
8.2.3 Posterior Analysis in the Homoscedastic Case
8.2.4 Posterior Analysis for the Heteroscedastic Case
8.2.5 Predictive Density for the SETAR Model
8.3 Pathological Aspects of Threshold Models
8.3.1 The Nature of the Threshold
8.3.2 Identification in Abrupt Transition Models
8.3.3 Identification in Smooth Transition Models
8.3.3.1 Identification at γ = 0
8.3.3.2 Integrability
8.4 Testing for Linearity and Model Selection
8.4.1 Model Selection
8.4.2 A Lnearity Test Based on the Posterior Density
8.4.3 A Numerical Example
8.5 Empirical Applications
8.5.1 A Consumption Function for France
8.5.2 United States Business Cycle Asymmetries
8.6 Disequilibrium Models
8.6.1 Maximum Likelihood Estimation
8.6.2 The Structure of the Posterior Density
8.6.3 Elicitation of Prior Information on β
8.6.4 Numerical Evaluation of the Posterior Density
8.6.5 Endogenous Prices and Other Regime Indicators
8.7 Conclusion
9: Systems of Equations
Abstract and Keywords
9.1 Introduction
9.2 VAR Models
9.2.1 Unrestricted VAR Models and Multivariate Regression
9.2.2 Restricted VAR Models and SURE Models
9.2.3 The Minnesota Prior for VAR Models
9.3 Cointegration and VAR Models
9.3.1 Model Formulation
9.3.2 Identification Issues
9.3.3 Likelihood Function and Prior Density
9.3.4 Posterior Results
9.3.4.1 The Case of a Single Cointegrating Vector
9.3.4.2 The Case of Several Cointegrating Vectors
9.3.5 Examples
9.3.5.1 A Money Demand Equation
9.3.5.2 Import Demand and Prices
9.3.6 Selecting the Cointegration Rank
9.4 Simultaneous Equation Models
9.4.1 Limited Information Analysis
9.4.2 Full Information Analysis
Appendix A Probability Distributions
A.1 Univariate Distributions
A.1.1 The Uniform Distribution
A.1.2 The Gamma, Chi-squared, and Beta Distributions
A.1.2.1 The Gamma Function
A.1.2.2 The Gamma Distribution
A.1.2.3 The Chi-squared Distribution
A.1.2.4 The Gamma-2 and Gamma-1 Distributions
A.1.2.5 The Inverted Gamma-2 and Gamma-1 Distributions
A.1.2.6 The Beta Distribution
A.1.3 The Univariate Normal Distribution
A.1.4 Distributions Related to the Univariate Normal Distribution
A.1.4.1 The Univariate Student Distribution
A.1.4.2 The Hotelling and F-distributions
A.2 Multivariate Distributions
A.2.1 Preliminary: Choleski Decomposition
A.2.2 The Multivariate Normal Distribution
A.2.3 The Matricvariate Normal Distribution
A.2.4 The Normal–Inverted Gamma-2 Distribution
A.2.5 The Multivariate Student Distribution
A.2.6 The Inverted Wishart Distribution
A.2.7 The Matricvariate Student Distribution
Appendix B Generating random numbers
B.1 General Methods for Univariate Distributions
B.1.1 Inverse Transform Method
B.1.2 Acceptance-Rejection Method
B.1.3 Compound or Data Augmentation Method
B.2 Univariate Distributions
B.2.1 Exponential Distribution
B.2.2 Gamma Distribution
B.2.3 Chi-squared Distribution
B.2.4 Inverted Gamma-2 Distribution
B.2.5 Beta Distribution
B.2.6 Normal Distribution
B.2.7 Student Distribution
B.2.8 Cauchy Distribution
B.3 General Methods for Multivariate Distributions
B.3.1 Multivariate Transformations
B.3.2 Factorization into Marginals and Conditionals
B.3.3 Markov Chains
B.4 Multivariate Distributions
B.4.1 Multivariate Normal
B.4.2 Multivariate Student
B.4.3 Matricvariate Normal
B.4.4 Inverted Wishart
B.4.5 Matricvariate Student
B.4.6 Poly-t 2–0
B.4.7 Poly-t 1–1
References
Subject Index
Author Index