GLM: Linear/Logistic Regression with L1 ∨ L2 Regularization GAM: Generalized Additive Models using B-splines Tree: Decision Tree for Classification and Regression FIGS: Fast Interpretable Greedy-Tree Sums (Tan, et al. 2022) XGB1: Extreme Gradient Boosted Trees of Depth 1, with optimal binning ...
Ridge regression, also known as L2 Regularization, is a regression technique that introduces a small amount of bias to reduce overfitting. It does this by minimizing the sum of squared residualsplusa penalty, where the penalty is equal to lambda times the slope squared. Lambda refers to the se...