Growing self consistent galaxies in empirically modelled environments using steel: the STatistical sEmi-Empirical modeL