It is a well-known result (which can be traced back to Gauss) that the only translation family of probability densities on \(\mathbb{R}\) for which the arithmetic mean is a maximum likelihood estimate of the translation parameter originates from the normal density. We generalize this characterizatio
Efficient ML Estimation of the Multivariate Normal Distribution from Incomplete Data
โ Scribed by Chuanhai Liu
- Publisher
- Elsevier Science
- Year
- 1999
- Tongue
- English
- Weight
- 136 KB
- Volume
- 69
- Category
- Article
- ISSN
- 0047-259X
No coin nor oath required. For personal study only.
โฆ Synopsis
It is well known that the maximum likelihood estimates (MLEs) of a multivariate normal distribution from incomplete data with a monotone pattern have closed-form expressions and that the MLEs from incomplete data with a general missing-data pattern can be obtained using the Expectation-Maximization (EM) algorithm. This article gives closed-form expressions, analogous to the extension of the Bartlett decomposition, for both the MLEs of the parameters and the associated Fisher information matrix from incomplete data with a monotone missing-data pattern. For MLEs of the parameters from incomplete data with a general missing-data pattern, we implement EM and Expectation-Constrained-Maximization-Either (ECME), by augmenting the observed data into a complete monotone sample. We also provide a numerical example, which shows that the monotone EM (MEM) and monotone ECME (MECME) algorithms converge much faster than the EM algorithm.
๐ SIMILAR VOLUMES
The problem considered in this paper is the estimation of the underlying order of rn physiological changes from incomplete observations. The observations are incomplete in the sense that, for each individual in the sample, only the identity, but not the order, of the first k < rn changes are observe
In evaluating prognostic factors by means of regression models, missing values in the covariate data are a frequent complication. There exist statistical tools to analyse such incomplete data in an efficient manner, and in this paper we make use of the traditional maximum likelihood principle. As we