Regularization in Deep Learning is very important to overcome overfitting. When your training accuracy is very high, but test accuracy is very low, the model highly overfits the training dataset set ...

A simple and clear explanation of stochastic depth — a powerful regularization technique that improves deep neural network ...