DecodeAI
Machine Learning Foundations
Free

Loss, Metrics & Evaluation

Pick losses and metrics that match the decision you are making.

Cheatsheet — Metrics

SituationPrefer
Balanced classesAccuracy / ROC-AUC
Rare positivesPR-AUC, recall@k
Outlier-heavy regressionMAE
Ranking qualityNDCG / MAP

Hold out a final test set until the last evaluation.