Learning Embodied Agents with Scalably-Supervised Reinforcement Learning