Asymmetry Learning for Out-of-distribution Tasks