Difference between MSE and Gradient descent
The MSE is a comparison of the estimator and the true parameter. For more click here