Model Checkpointing

Only the model weights need to be saved; optimizer state is irrelevant Checkpoints should include model weights, optimizer state, epoch number, and any scheduler state, enabling training to resume exactly from where it stopped Checkpoints are only needed for inference, not for resuming training Checkpoints should only be saved after training is fully complete