Support Vector Machines
[markdown] content available only on the platform
[markdown] content available only on the platform
Flashcards · Support Vector Machines
Widest margin — SVM's rule for choosing a boundary: the one furthest from the nearest points of both classes.
A line midway between the two clusters.
Support vectors — The training points closest to the boundary; removing one changes the hyperplane, removing others does not.
model.support_vectors_
Kernel function — A function computing similarity (inner products) as if data were in a higher-dimensional space, without building that space.
kernel='rbf'
gamma — An RBF kernel setting that controls how far the influence of a single training point reaches.
SVC(kernel='rbf', gamma='scale')
C parameter — Penalty for misclassified training points: large C narrows the margin and risks overfitting; small C widens it.
SVC(C=1.0)
Standardisation before SVM — Rescaling features to mean 0 and standard deviation 1 so no feature dominates SVM's distances.
make_pipeline(StandardScaler(), SVC())
poly kernel — A kernel for boundaries that follow polynomial relationships between features.
SVC(kernel='poly', degree=2)
Memory efficiency — SVM needs only its support vectors at prediction time, a small fraction of the training data.
Store 30 support vectors instead of 5,000 rows.
