1. Local Response Normalization (LRN) - performs a kind of
“lateral inhibition” by normalizing over local input
regions.
2. Mean Variance Normalization (MVN) - performs contrast
normalization / instance normalization.
3. Batch Normalization- performs normalization over mini-batches
the bias and scale layers can be helpful in combination with normalization.