Stochastic gradient descent (SGD) is one of the preferred online optimization algorithms. However, o...