Applying the Complete Machine Learning Workflow
[markdown] content available only on the platform
[markdown] content available only on the platform
Flashcards · Applying the Complete Machine Learning Workflow
Machine learning workflow — The ordered steps from defining a problem to interpreting and deploying an evaluated model.
Define, collect, EDA, split, preprocess, baseline, tune, test, interpret.
EDA (exploratory data analysis) — Exploring the data's distributions, missing values and outliers before modelling.
data.describe(); data.isna().sum()
stratify=y — train_test_split option that keeps the class proportions the same in train and test sets.
train_test_split(x, y, test_size=0.2, stratify=y)
SimpleImputer — scikit-learn transformer that fills missing values, for example with the column median.
SimpleImputer(strategy='median')
best_estimator_ — The model from GridSearchCV refitted with the best hyperparameters on the whole training set.
search.best_estimator_.predict(x_test)
Single test evaluation — Running the test set exactly once, after all modelling decisions are final.
The last step before interpretation.
Error analysis — Studying which kinds of errors a model makes and whether they are acceptable in context.
24 false negatives in diabetes screening is serious.
Fairness problem — A model that performs much worse for a specific group of people than overall.
85% accuracy overall, 60% for one user group.
Data drift — A difference between the data seen at deployment and the data used for training.
Training patients aged 20-50, real patients mostly over 60.
