Reliable and Adaptive Stochastic Optimization in the Face of Messy Data