{INFaaS}: Automated model-less inference serving
Despite existing work in machine learning inference serving, ease-of-use and cost efficiency
remain challenges at large scales. Developers must manually search through thousands of …
remain challenges at large scales. Developers must manually search through thousands of …
Server-driven video streaming for deep learning inference
Video streaming is crucial for AI applications that gather videos from sources to servers for
inference by deep neural nets (DNNs). Unlike traditional video streaming that optimizes …
inference by deep neural nets (DNNs). Unlike traditional video streaming that optimizes …
From laptop to lambda: Outsourcing everyday jobs to thousands of transient functional containers
We present gg, a framework and a set of command-line tools that helps people execute
everyday applications—eg, software compilation, unit tests, video encoding, or object …
everyday applications—eg, software compilation, unit tests, video encoding, or object …
Llama: A heterogeneous & serverless framework for auto-tuning video analytics pipelines
The proliferation of camera-enabled devices and large video repositories has led to a
diverse set of video analytics applications. These applications rely on video pipelines …
diverse set of video analytics applications. These applications rely on video pipelines …
[PDF][PDF] Challenges and Opportunities in DNN-Based Video Analytics: A Demonstration of the BlazeIt Video Query Engine.
As video volumes grow, analysts are increasingly able to query the real world. Since
manually watching these growing volumes of video is infeasible, analysts have increasingly …
manually watching these growing volumes of video is infeasible, analysts have increasingly …
Optimizing video analytics with declarative model relationships
The availability of vast video collections and the accuracy of ML models has generated
significant interest in video analytics systems. Since naively processing all frames using …
significant interest in video analytics systems. Since naively processing all frames using …
Visor:{Privacy-Preserving} video analytics as a cloud service
Video-analytics-as-a-service is becoming an important offering for cloud providers. A key
concern in such services is privacy of the videos being analyzed. While trusted execution …
concern in such services is privacy of the videos being analyzed. While trusted execution …
A survey of performance optimization in neural network-based video analytics systems
Video analytics systems perform automatic events, movements, and actions recognition in a
video and make it possible to execute queries on the video. As a result of a large number of …
video and make it possible to execute queries on the video. As a result of a large number of …
Morphling: Fast, near-optimal auto-configuration for cloud-native model serving
Machine learning models are widely deployed in production cloud to provide online
inference services. Efficiently deploying inference services requires careful tuning of …
inference services. Efficiently deploying inference services requires careful tuning of …
Vstore: A data store for analytics on large videos
We present VStore, a data store for supporting fast, resource-efficient analytics over large
archival videos. VStore manages video ingestion, storage, retrieval, and consumption. It …
archival videos. VStore manages video ingestion, storage, retrieval, and consumption. It …