The Power of Adaptivity for Decision-Making under Uncertainty