Empowering adaptive early-exit inference with latency awareness

X Tan, H Li, L Wang, X Huang, Z Xu - Proceedings of the AAAI …, 2021 - ojs.aaai.org
With the capability of trading accuracy for latency on-the-fly, the technique of adaptive early-
exit inference has emerged as a promising line of research to accelerate the deep learning …