-
Regularizing a boosted model: reg_lambda, reg_alpha, gamma, and the constraints that matter
XGBoost does not regularize a tree in quite the same way that ridge regression or Lasso regularizes a linear model. A standard tree booster does not have one coefficient per input feature. Instead, it
-
Regularization in practice: telling underfitting from overfitting and choosing the strength
A machine learning model can fail in two opposite ways.
-
Ridge, lasso, and elastic net: what L1 and L2 actually do to your coefficients
Linear regression is one of the easiest machine learning algorithms to understand—and one of the easiest to get wrong when your features are correlated, noisy, or measured on wildly different scales.
-
Overfitting on purpose: dropout, weight decay, and early stopping in one runnable lab
Machine learning tutorials often introduce overfitting as a failure mode: the model memorizes the training data, performs brilliantly on examples it has already seen, and then collapses on new data.