{INFaaS}: Automated model-less inference serving

F Romero, Q Li, NJ Yadwadkar… - 2021 USENIX Annual …, 2021 - usenix.org
Despite existing work in machine learning inference serving, ease-of-use and cost efficiency
remain challenges at large scales. Developers must manually search through thousands of …

Server-driven video streaming for deep learning inference

K Du, A Pervaiz, X Yuan, A Chowdhery… - Proceedings of the …, 2020 - dl.acm.org
Video streaming is crucial for AI applications that gather videos from sources to servers for
inference by deep neural nets (DNNs). Unlike traditional video streaming that optimizes …

From laptop to lambda: Outsourcing everyday jobs to thousands of transient functional containers

S Fouladi, F Romero, D Iter, Q Li, S Chatterjee… - 2019 USENIX annual …, 2019 - usenix.org
We present gg, a framework and a set of command-line tools that helps people execute
everyday applications—eg, software compilation, unit tests, video encoding, or object …

Llama: A heterogeneous & serverless framework for auto-tuning video analytics pipelines

F Romero, M Zhao, NJ Yadwadkar… - Proceedings of the ACM …, 2021 - dl.acm.org
The proliferation of camera-enabled devices and large video repositories has led to a
diverse set of video analytics applications. These applications rely on video pipelines …

[PDF][PDF] Challenges and Opportunities in DNN-Based Video Analytics: A Demonstration of the BlazeIt Video Query Engine.

D Kang, P Bailis, M Zaharia - CIDR, 2019 - cs.purdue.edu
As video volumes grow, analysts are increasingly able to query the real world. Since
manually watching these growing volumes of video is infeasible, analysts have increasingly …

Optimizing video analytics with declarative model relationships

F Romero, J Hauswald, A Partap, D Kang… - Proceedings of the …, 2022 - dl.acm.org
The availability of vast video collections and the accuracy of ML models has generated
significant interest in video analytics systems. Since naively processing all frames using …

Visor:{Privacy-Preserving} video analytics as a cloud service

R Poddar, G Ananthanarayanan, S Setty… - 29th USENIX Security …, 2020 - usenix.org
Video-analytics-as-a-service is becoming an important offering for cloud providers. A key
concern in such services is privacy of the videos being analyzed. While trusted execution …

A survey of performance optimization in neural network-based video analytics systems

N Ibrahim, P Maurya, O Jafari, P Nagarkar - arXiv preprint arXiv …, 2021 - arxiv.org
Video analytics systems perform automatic events, movements, and actions recognition in a
video and make it possible to execute queries on the video. As a result of a large number of …

Morphling: Fast, near-optimal auto-configuration for cloud-native model serving

L Wang, L Yang, Y Yu, W Wang, B Li, X Sun… - Proceedings of the …, 2021 - dl.acm.org
Machine learning models are widely deployed in production cloud to provide online
inference services. Efficiently deploying inference services requires careful tuning of …

Vstore: A data store for analytics on large videos

T Xu, LM Botelho, FX Lin - … of the Fourteenth EuroSys Conference 2019, 2019 - dl.acm.org
We present VStore, a data store for supporting fast, resource-efficient analytics over large
archival videos. VStore manages video ingestion, storage, retrieval, and consumption. It …