Statistical Analysis of Curved Probability Densities

✍ Scribed by M. Taniguchi; Y. Watanabe

• Publisher: Elsevier Science
• Year: 1994
• Tongue: English
• Weight: 615 KB
• Volume: 48
• Category: Article
• ISSN: 0047-259X
• DOI: 10.1006/jmva.1994.1004

✦ Synopsis

Suppose that (p_{n}(\cdot ; \theta)) is the joint probability density of (n) observations which are not necessarily i.i.d. In this paper we discuss the estimation of an unknown parameter (u) of a family of "curved probability densities" defined by (\mathbf{M}=\left{p_{n}(\cdot ; \theta(u)), \operatorname{dim} u<\operatorname{dim} \theta\right}) embedded in (\mathbf{S}=\left{p_{n}(\cdot ; \theta), \theta \in \boldsymbol{\theta}\right}), and develop the higher order asymptotic theory. The third-order Edgeworth expansion for a class of estimators is derived. It is shown that the maximum likelihood estimator is still third-order asymptotically optimal in our general situation. However, the Edgeworth expansion contains two terms which vanish in the case of curved exponential family. Regarding this point we elucidate some results which did not appear in Amari's framework. Our results are applicable to time series analysis and multivariate analysis. We give a few examples (e.g., a family of curved ARMA models, a family of curved regression models). , 1994 Academic Press, Inc.