Tag: L1 and L2 regularization
What is L1 and L2 regularization in Deep Learning?
L1 and L2 regularization are two of the most common ways to reduce overfitting in deep neural networks. L1 regularization is performing a linear transformation on the weights of your neural network. L2 regularization is adding a squared cost function to your loss function. This cost function penalizes the sum of the absolute values of…
Read More