Dynamic vs Static Computation Graphs

Dynamic graphs are always faster at inference time Dynamic graphs allow using standard Python debuggers and native control flow because the graph is constructed at runtime Dynamic graphs require less GPU memory Dynamic graphs automatically optimize network architecture