Capstone Practice: Choosing an Algorithm for Your Problem
[markdown] content available only on the platform
[markdown] content available only on the platform
Flashcards · Capstone Practice: Choosing an Algorithm for Your Problem
Regression problem — A task whose target is a continuous number.
Predicting house price in billion VND.
Classification problem — A task whose target is a category or class label.
Approve or reject a loan application.
Interpretability — How easily people can understand why a model made a particular prediction.
A decision tree path explains a loan rejection.
Baseline model — A simple first model that gives a reference score for judging more complex models.
LogisticRegression before trying Random Forest.
Algorithm selection criteria — Factors used to choose a model: target type, explainability, linearity, data size and preprocessing needs.
Small, explainable classification task -> shallow decision tree.
Shallow tree — A decision tree with limited depth, which is easier to explain and less likely to overfit.
DecisionTreeClassifier(max_depth=3)
Accuracy reference model — A powerful but less explainable model used to see how much accuracy an explainable model gives up.
Compare a shallow tree with RandomForestClassifier.
