Optimization interview questions.
A curated set of 14 questions that repeatedly exercise Optimization concepts in AI/ML interviews.
How do learning-rate schedules affect training?ML Fundamentals · medium · Evidence 75/100Compare common loss functions and when to use them.ML Fundamentals · medium · Evidence 75/100When would you prefer gradient descent to the normal equation?ML Fundamentals · medium · Evidence 75/100When would you choose SGD instead of Adam?ML Fundamentals · medium · Evidence 75/100Compare first-order and second-order optimizersML Fundamentals · hard · Evidence 75/100Dropout vs weight decayML Fundamentals · medium · Evidence 47/100SVM Margin and Hinge LossML Math · medium · Evidence 41/100How would you reduce memory movement in a custom CUDA inference kernel?ML Coding & PyTorch · hard · Evidence 41/100How would you optimize a poorly training neural network?ML Fundamentals · medium · Evidence 40/100Compare common optimizers and their trade-offsML Fundamentals · medium · Evidence 40/100Compare SFT, RLHF, and preference optimizationGenAI & LLM · medium · Evidence 40/100SGD vs AdamML Fundamentals · medium · Evidence 34/100Mini-batch Training TradeoffsML Math · medium · Evidence 34/100Learning Rate SchedulingML Fundamentals · medium · Evidence 34/100