Company Focus

OpenAI Interview Problems (37)

Problems reported from OpenAI data science interviews

Status Title Difficulty
BERT vs GPT Pre-training Pro Easy
ReLU Activation Function Free Easy
Softmax Output Layer Pro Easy
Temperature in Text Generation Free Easy
TensorBoard Usage Pro Easy
Unlock all 37+ problems
Top-k and Top-p Sampling Pro Easy
Transfer Learning Benefit Pro Easy
What Is a Token in LLMs? Free Easy
What Is BPE Tokenization? Pro Easy
What Is Model Hallucination? Pro Easy
Unlock all 37+ problems
Zero-Shot vs Few-Shot Learning Free Easy
Chain-of-Thought Prompting Pro Medium
Context Window Limitations Pro Medium
DPO vs RLHF Pro Medium
Emergent Abilities in LLMs Pro Medium
Unlock all 37+ problems
Hugging Face Transformers Library Pro Medium
Instruction Tuning Pro Medium
Layer Normalization vs Batch Normalization Pro Medium
Learning Rate Warmup Pro Medium
LoRA Fine-Tuning Pro Medium
Unlock all 37+ problems
Mixed Precision Training Pro Medium
Multi-Head Attention Pro Medium
Perplexity as an Evaluation Metric Pro Medium
Positional Encoding in Transformers Pro Medium
Prompt Engineering Techniques Pro Medium
Unlock all 37+ problems
Show 25 50 100 per page