Clipper: A {Low-Latency} online prediction serving system
14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17), 2017•usenix.org
… Finally, we compare Clipper to the Tensorflow Serving system and demonstrate that we
are able to achieve comparable throughput and latency while enabling model composition
and online learning to improve accuracy and render more robust predictions. … We compare
Clipper to the Google TensorFlow Serving system [59], an industrial grade prediction
serving system tightly integrated with the TensorFlow training framework. We demonstrate
that Clipper’s modular design and broad functionality impose minimal performance …
are able to achieve comparable throughput and latency while enabling model composition
and online learning to improve accuracy and render more robust predictions. … We compare
Clipper to the Google TensorFlow Serving system [59], an industrial grade prediction
serving system tightly integrated with the TensorFlow training framework. We demonstrate
that Clipper’s modular design and broad functionality impose minimal performance …
Abstract
Machine learning is being deployed in a growing number of applications which demand real-time, accurate, and robust predictions under heavy query load. However, most machine learning frameworks and systems only address model training and not deployment.
usenix.org
以上显示的是最相近的搜索结果。 查看全部搜索结果