Modal Accuracy And Optimisation

• Are you predicting probabilities?
  • Do you need class labels?
    • Is the positive class more important?
      • Use Precision-Recall AUC
    • Are both classes important?
      • Use ROC AUC
  • Do you need probabilities?
    • Use Brier Score and Brier Skill Score
• Are you predicting class labels?
  • Is the positive class more important?
    • Are False Negatives and False Positives Equally Important?
      • Use F1-Measure
    • Are False Negatives More Important?
      • Use F2-Measure
    • Are False Positives More Important?
      • Use F0.5-Measure
  • Are both classes important?
    • Do you have < 80%-90% Examples for the Majority Class? 
      • Use Accuracy