Linear Regression Constrained to a Ball

✍ Scribed by Petre Stoica; Girish Ganesan

• Publisher: Elsevier Science
• Year: 2001
• Tongue: English
• Weight: 226 KB
• Volume: 11
• Category: Article
• ISSN: 1051-2004
• DOI: 10.1006/dspr.2000.0371

✦ Synopsis

A worst case lower bound (WCLB) result obtained by Nemirovskii suggests that a potentially significant estimation accuracy enhancement may be achieved provided the true parameter vector is known to belong to a ball. In this paper we discuss the many facets and implications of Nemirovskii's result by using linear regression as a vehicle for illustration. In particular, we address briefly such issues as biased versus unbiased estimation, minimax optimal estimation, tightness of the WCLB, and comparison of WCLB with the performance of the least squares estimator constrained to the ball and that of the linear minimax estimator.