2.7 SVM: Maximum Margin and Support Vectors
[video] /api/lesson-media/videos/9b417aa2-5e9f-4ae3-a9db-2a3b7f03f372-1794614928101-6666fffd492c101a.mp4
[markdown] content available only on the platform
[markdown] content available only on the platform
Flashcards · 2.7 SVM: Maximum Margin and Support Vectors
Margin — The width of the empty corridor between the decision boundary and the nearest points of each class.
The gap between the two yellow dashed lines.
Maximum margin classifier — A classifier that chooses, among all separating boundaries, the one with the widest margin; this describes SVM.
SVM picks the line in the middle of the gap.
Support vectors — The training points closest to the boundary, lying on the margin edge; they alone fix the boundary's position.
The three red-circled points on the slide.
Robust boundary — A boundary far from both classes, so new points must be unusual to land on the wrong side.
Driving down the centre of the lane.
Hyperparameter C — SVM setting that trades margin width against training errors: small C allows mistakes, large C narrows the margin.
SVC(C=0.1) tolerates errors; SVC(C=1000) does not.
Memory efficiency of SVM — A trained SVM only needs its support vectors to make predictions, not the whole training set.
model.support_vectors_ holds the stored points.
SVC — The scikit-learn class for SVM classification.
SVC(kernel='linear', C=1.0).fit(X, y)
