Back to the lessonPreparing the printout…

Fundamental of Machine Learning · Module 3: Model Evaluation and Optimization

Applying the Complete Machine Learning Workflow

[markdown] content available only on the platform

[markdown] content available only on the platform

Flashcards · Applying the Complete Machine Learning Workflow

Machine learning workflow — The ordered steps from defining a problem to interpreting and deploying an evaluated model.

Define, collect, EDA, split, preprocess, baseline, tune, test, interpret.

EDA (exploratory data analysis) — Exploring the data's distributions, missing values and outliers before modelling.

data.describe(); data.isna().sum()

stratify=y — train_test_split option that keeps the class proportions the same in train and test sets.

train_test_split(x, y, test_size=0.2, stratify=y)

SimpleImputer — scikit-learn transformer that fills missing values, for example with the column median.

SimpleImputer(strategy='median')

best_estimator_ — The model from GridSearchCV refitted with the best hyperparameters on the whole training set.

search.best_estimator_.predict(x_test)

Single test evaluation — Running the test set exactly once, after all modelling decisions are final.

The last step before interpretation.

Error analysis — Studying which kinds of errors a model makes and whether they are acceptable in context.

24 false negatives in diabetes screening is serious.

Fairness problem — A model that performs much worse for a specific group of people than overall.

85% accuracy overall, 60% for one user group.

Data drift — A difference between the data seen at deployment and the data used for training.

Training patients aged 20-50, real patients mostly over 60.

Fundamental of Machine Learning · Applying the Complete Machine Learning Workflow · printed on November 20, 2026