Empowering adaptive early-exit inference with latency awareness
With the capability of trading accuracy for latency on-the-fly, the technique of adaptive early-
exit inference has emerged as a promising line of research to accelerate the deep learning …
exit inference has emerged as a promising line of research to accelerate the deep learning …