第三講:Kernel Support Vector Machine
kernel as a shortcut to (transform + inner product): allowing a spectrum of models ranging from simple linear ones to infinite dimensional ones with margin control
第四講:Soft-Margin Support Vector Machine
a new primal formulation that allows some penalized margin violations, which is equivalent to a dual formulation with upper-bounded variables
第五講:Kernel Logistic Regression
soft-classification by an SVM-like sparse model using two-level learning, or by a "kernelized" logistic regression model using representer theorem
第六講:Support Vector Regression
kernel ridge regression via ridge regression + representer theorem, or support vector regression via regularized tube error + Lagrange dual
第七講:Blending and Bagging
blending known diverse hypotheses uniformly, linearly, or even non-linearly; obtaining diverse hypotheses from bootstrapped data
第八講:Adaptive Boosting
"optimal" re-weighting for diverse hypotheses and adaptive linear aggregation to boost weak algorithms
第九講:Decision Tree
recursive branching (purification) for conditional aggregation of simple hypotheses
第十講:Random Forest
bootstrap aggregation of randomized decision trees with automatic validation
第十一講:Gradient Boosted Decision Tree
aggregating trees from functional + steepest gradient descent subject to any error measure
第十二講:Neural Network
automatic feature extraction from layers of neurons with the back-propagation technique for stochastic gradient descent
第十三講:Deep Learning
an early and simple deep learning model that pre-trains with denoising autoencoder and fine-tunes with back-propagation
第十四講:Radial Basis Function Network
linear aggregation of distance-based similarities to prototypes found by clustering
第十五講:Matrix Factorization
linear models of items on extracted user features (or vice versa) jointly optimized with stochastic gradient descent for recommender systems
第十六講:Finale
summary from the angles of feature exploitation, error optimization, and overfitting elimination towards practical use cases of machine learning