|
|
Purpose of Positional Encoding
Pro
|
Easy
|
Conceptual
|
|
llms
|
|
|
Vanishing Gradient Problem
Pro
|
Easy
|
Conceptual
|
|
neural-networks
|
|
|
Adam Optimizer Internals
Pro
|
Medium
|
Conceptual
|
|
neural-networks
|
|
|
DPO vs RLHF
Pro
|
Medium
|
Conceptual
|
|
llms
|
|
|
Emergent Abilities in LLMs
Pro
|
Medium
|
Conceptual
|
|
llms
|
|
Unlock all 25+ problems
|
|
|
He Initialization for ReLU
Pro
|
Medium
|
Conceptual
|
|
neural-networks
|
|
|
Multi-Head Attention
Pro
|
Medium
|
Conceptual
|
|
llms
|
|
|
Positional Encoding in Transformers
Pro
|
Medium
|
Conceptual
|
|
neural-networks
|
|
|
Random Search vs Grid Search
Pro
|
Medium
|
Conceptual
|
|
machine-learning
|
|
|
RLHF Training Pipeline
Pro
|
Medium
|
Conceptual
|
|
llms
|
|
Unlock all 25+ problems
|
|
|
Self-Attention Mechanism
Pro
|
Medium
|
Conceptual
|
|
llms
|
|
|
Xavier Weight Initialization
Pro
|
Medium
|
Conceptual
|
|
neural-networks
|
|
|
AdaGrad Limitations
Pro
|
Hard
|
Conceptual
|
|
neural-networks
|
|
|
AI Alignment Challenges
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
|
Constitutional AI
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
Unlock all 25+ problems
|
|
|
Decision Tree Stump
Pro
|
Hard
|
Python
|
|
machine-learning
|
|
|
Exploding Gradients and Gradient Clipping
Pro
|
Hard
|
Conceptual
|
|
neural-networks
|
|
|
GAN Training Dynamics
Pro
|
Hard
|
Conceptual
|
|
neural-networks
|
|
|
K-Means Clustering
Pro
|
Hard
|
Python
|
|
machine-learning
|
|
|
Mixture of Experts Architecture
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
Unlock all 25+ problems
|
|
|
Neural Network Forward Pass
Pro
|
Hard
|
Python
|
|
machine-learning
|
|
|
Scaling Laws and Chinchilla
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
|
Speculative Decoding
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
|
Transformer Architecture Deep Dive
Pro
|
Hard
|
Conceptual
|
|
llms
|
|
|
Variational Autoencoder Latent Space
Pro
|
Hard
|
Conceptual
|
|
neural-networks
|
|
Unlock all 25+ problems
|