What is vanishing gradients?

Data Science, AI and ML
,
#1

What is vanishing gradients?

#2

In vanishing gradient, the gradient becomes very small (close to 0 ) which leads to a very small change in weights (or almost no change). No change in weights (i.e. gradient=0 ) is a condition for termination, but this is NOT a converged solution.
https://levelup.gitconnected.com/vanishing-and-exploding-gradients-ae7fb88f3b66