Skip Connections in ResNets

Medium

neural-networks Google Meta NVIDIA

ResNets introduce skip (residual) connections that add the input of a block to its output. Why do these connections enable training of much deeper networks?

Multiple Choice

They create shortcut paths for gradients to flow directly to earlier layers, mitigating vanishing gradients and making it easy to learn identity mappings They double the number of features at each layer, giving the network more capacity They allow the network to skip computationally expensive layers at inference time They implement an ensemble of shallow networks within a single deep architecture

Correct!

Incorrect — try again next time!

Upgrade to Pro to unlock solutions and explanations

Skip Connections in ResNets

Multiple Choice

Related problems

Deep-dive guides