Residuals, Leverage and Over-fitting: Advanced Problem… | StemPy Lab
Standard content
“Residuals, Leverage and Over-fitting: Advanced Problem Workshop” is available to Standard subscribers.
A line with r = 0.95 can still be the wrong line. One far point can drag it, a lucky group can fall back, and a curve can fit eight points perfectly and predict nothing. Here you check a regression the way a statistician does. You read the residual plot honestly and choose a transformation. You find the points with leverage and the misses they hide, and catch a slope that reverses between groups. Then you measure how much a slope would wobble in a new sample, and test a model on data it has never seen. Twelve hard problems carry most of the work. The level is that of a first university course in statistics, A-Level Further Maths statistics and AP Statistics.
3Lessons12Problems2Python Labs1Question Set1Mock Test
Reading residual plots and choosing a transformation: A high r can sit on top of a line with the wrong shape. This lesson reads residual plots honestly: what a pattern means, and how often pure chance draws one. Then it chooses a transformation from the plot, and reads a power law on log-log axes.
Outliers, leverage and influence: One unusual point can leave the line alone, raise r, or drag the slope a long way. This lesson tells the three apart with leverage, shows how a dangerous point hides with a small residual, and ends with groups that reverse a slope.
Regression to the mean, uncertainty and over-fitting: A line from a sample is uncertain, and luck can make a pattern of its own. This lesson builds regression to the mean from pure luck and measures the wobble of a slope by resampling. Then it tells two kinds of interval apart, and catches a curve that fits too well.