Towards efficient deep learning for ubiquitous and scalable AI