Pointwise Consistency of Regression Trees and the Bias-Variance Trade-Off Associated with Tree Size

Regression trees can be made pointwise consistent by controlling the minimum number of observations in each cell. This leads to a bias-variance trade-off associated with tree size, where small trees are biased but have low variance, while large trees are unbiased but have high variance. Subagging can improve the variance of consistent trees without affecting the bias.