GenAI & LLM interview questions.
Practice 51 high-signal questions covering the concepts and decisions interviewers probe in GenAI & LLM.
How is BERT different from GPT?GenAI & LLM · medium · Evidence 88/100Explain Transformer architecture and each major component.GenAI & LLM · medium · Evidence 88/100Explain the attention mechanism in a Transformer.GenAI & LLM · medium · Evidence 78/100Explain core NLP and deep-learning concepts used in an Alexa system.GenAI & LLM · medium · Evidence 77/100How does an LSTM differ from a Transformer?GenAI & LLM · medium · Evidence 75/100Explain Transformer fundamentals for a multimodal role.GenAI & LLM · medium · Evidence 75/100Explain LoRA and why it reduces fine-tuning cost.GenAI & LLM · medium · Evidence 75/100Explain attention in modern neural networks.GenAI & LLM · medium · Evidence 75/100What are sparse-attention methods in Transformers?GenAI & LLM · hard · Evidence 75/100Explain core NLP modeling choices.GenAI & LLM · medium · Evidence 75/100Design a small polite LLM that runs on a phoneGenAI & LLM · hard · Evidence 75/100Explain BERT and its pretraining objectives.GenAI & LLM · medium · Evidence 75/100Explain Transformers in an NLP context.GenAI & LLM · medium · Evidence 75/100Compare major LLM fine-tuning techniques.GenAI & LLM · hard · Evidence 75/100How would you evaluate an LLM?GenAI & LLM · medium · Evidence 75/100How can Transformers be used in recommendation systems?GenAI & LLM · hard · Evidence 75/100Analyze the space complexity of major Transformer components.GenAI & LLM · hard · Evidence 75/100Design a RAG system that generates presentation slides from a user prompt.GenAI & LLM · hard · Evidence 75/100Explain how RAG works end to end.GenAI & LLM · medium · Evidence 75/100Design a RAG system end to end.GenAI & LLM · hard · Evidence 75/100How do DPO and RLHF differ?GenAI & LLM · hard · Evidence 75/100Explain BLIP-2 at a high level.GenAI & LLM · hard · Evidence 75/100Describe Segment Anything Model (SAM) at a high level.GenAI & LLM · hard · Evidence 75/100Explain the architecture of attention.GenAI & LLM · medium · Evidence 75/100Why use RAG instead of fine-tuning an LLM?GenAI & LLM · medium · Evidence 66/100Explain supervised fine-tuning for LLMs.GenAI & LLM · medium · Evidence 66/100Explain embeddings, tokenization, attention, and BERTGenAI & LLM · medium · Evidence 41/100Explain the relationship between self-attention and Transformer representations.GenAI & LLM · medium · Evidence 41/100How do tokenization choices affect professional-domain text?GenAI & LLM · medium · Evidence 41/100When would BERT be overkill compared with a simpler embedding model?GenAI & LLM · medium · Evidence 41/100How would you design fallback behavior when a Q&A bot cannot retrieve enough evidence?GenAI & LLM · hard · Evidence 41/100How would you evaluate retrieval quality separately from answer quality in a Q&A bot?GenAI & LLM · hard · Evidence 41/100How would you fuse image and text representations for a document model?GenAI & LLM · hard · Evidence 41/100Contrastive Learning for RecommendationGenAI & LLM · hard · Evidence 41/100Embeddings for Retrieval vs Token EmbeddingsGenAI & LLM · medium · Evidence 41/100How does knowledge distillation work and when would you use it?GenAI & LLM · medium · Evidence 41/100When would you use a multimodal model instead of separate unimodal models?GenAI & LLM · medium · Evidence 41/100For a Q&A bot, when would you add RAG instead of relying on a parametric model alone?GenAI & LLM · medium · Evidence 41/100How do continuous batching and paged attention improve LLM serving?GenAI & LLM · hard · Evidence 41/100Explain the architecture of an LLM serving stack built around vLLM.GenAI & LLM · hard · Evidence 41/100How does attention complexity affect long-document modeling?GenAI & LLM · hard · Evidence 41/100Explain tokenization choices for an LLMGenAI & LLM · medium · Evidence 40/100Compare SFT, RLHF, and preference optimizationGenAI & LLM · medium · Evidence 40/100How would you evaluate generative AI quality for a customer-facing product?GenAI & LLM · medium · Evidence 40/100How would you quantize a neural network for faster inference?GenAI & LLM · medium · Evidence 40/100Design text-to-image search with embeddingsGenAI & LLM · medium · Evidence 40/100Design concurrent LLM servingGenAI & LLM · hard · Evidence 37/100Transformer vs RNNGenAI & LLM · medium · Evidence 34/100What Is an LLM?GenAI & LLM · easy · Evidence 34/100QKV in Multi-Head AttentionGenAI & LLM · medium · Evidence 34/100Design RAG with strict source controlGenAI & LLM · hard · Evidence 31/100