Efficient Human-Machine Work Transfer Through Latent Structure Decomposition