The 60-second answer
Start from the target distribution and business cost: regression vs classification vs ranking, asymmetric errors, label noise, and class imbalance. Use likelihood-aligned defaults such as MSE for Gaussian-style regression or cross-entropy for categorical outcomes, then adapt when assumptions do not match.
Build the answer in this order
Start from the target distribution and business cost: regression vs classification vs ranking, asymmetric errors, label noise, and class imbalance.
Use likelihood-aligned defaults such as MSE for Gaussian-style regression or cross-entropy for categorical outcomes, then adapt when assumptions do not match.
For ranking/metric mismatch, use pairwise/listwise or differentiable surrogate losses and validate against the actual product metric.
Check optimization behavior, calibration, robustness to outliers/noise, and whether sample weighting changes the implied objective.
A useful interview mental model
This is the shape of a strong answer—not a script to memorize.
Senior-level signal
- Senior answers explicitly discuss surrogate-loss mismatch and why directly optimizing a business metric may be impossible or unstable.
- Include label-generation bias and delayed outcomes as part of the objective design.
What the interviewer is really testing
Likely follow-up questions
Common weak-answer patterns
- Reciting a definition without mechanism or assumptions.
- Claiming one technique is always better without a data regime.
- Stopping before failure modes, validation, or deployment implications.