Application of integral operator for regularized least-square regression
โ Scribed by Hongwei Sun; Qiang Wu
- Publisher
- Elsevier Science
- Year
- 2009
- Tongue
- English
- Weight
- 583 KB
- Volume
- 49
- Category
- Article
- ISSN
- 0895-7177
No coin nor oath required. For personal study only.
โฆ Synopsis
In this paper, we study the consistency of the regularized least-square regression in a general reproducing kernel Hilbert space. We characterize the compactness of the inclusion map from a reproducing kernel Hilbert space to the space of continuous functions and show that the capacity-based analysis by uniform covering numbers may fail in a very general setting. We prove the consistency and compute the learning rate by means of integral operator techniques. To this end, we study the properties of the integral operator. The analysis reveals that the essence of this approach is the isomorphism of the square root operator.
๐ SIMILAR VOLUMES
We investigate the rates of convergence of least-square estimator on sieves for regression under various weak dependency assumptions. We provide a control in probability for the rate of convergence and we show how to construct estimators of a smooth regression function at a rate which is known to be
Least median of squares (LMS) regression is a robust method to fit equations to observed data (typically in a linear model). This paper describes an approximation algorithm for LMS regression. The algorithm generates a regression solution with median residual no more than twice the optimal median re