Certain Systems Arising In Stochastic Gradient Descent