Pushing large language models to the 6g edge: Vision, challenges, and opportunities

Z Lin, G Qu, Q Chen, X Chen, Z Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs), which have shown remarkable capabilities, are
revolutionizing AI development and potentially shaping our future. However, given their …

{USHER}: Holistic Interference Avoidance for Resource Optimized {ML} Inference

SS Shubha, H Shen, A Iyer - 18th USENIX Symposium on Operating …, 2024 - usenix.org
Minimizing monetary cost and maximizing the goodput of inference serving systems are
increasingly important with the ever-increasing popularity of deep learning models. While it …

Edge Video Analytics: A Survey on Applications, Systems and Enabling Techniques

R Xu, S Razavi, R Zheng - IEEE Communications Surveys & …, 2023 - ieeexplore.ieee.org
Video, as a key driver in the global explosion of digital information, can create tremendous
benefits for human society. Governments and enterprises are deploying innumerable …

Known Knowns and Unknowns: Near-realtime Earth Observation Via Query Bifurcation in Serval

B Tao, O Chabra, I Janveja, I Gupta… - 21st USENIX Symposium …, 2024 - usenix.org
Earth observation satellites, in low Earth orbits, are increasingly approaching near-
continuous imaging of the Earth. Today, these satellites capture an image of every part of …

Artificial intelligence of things: A survey

SI Siam, H Ahn, L Liu, S Alam, H Shen, Z Cao… - ACM Transactions on …, 2024 - dl.acm.org
The integration of the Internet of Things (IoT) and modern Artificial Intelligence (AI) has given
rise to a new paradigm known as the Artificial Intelligence of Things (AIoT). In this survey, we …

Prioritized information bottleneck theoretic framework with distributed online learning for edge video analytics

Z Fang, S Hu, J Wang, Y Deng, X Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Collaborative perception systems leverage multiple edge devices, such surveillance
cameras or autonomous cars, to enhance sensing quality and eliminate blind spots. Despite …

AdaInf: Data Drift Adaptive Scheduling for Accurate and SLO-guaranteed Multiple-Model Inference Serving at Edge Servers

SS Shubha, H Shen - Proceedings of the ACM SIGCOMM 2023 …, 2023 - dl.acm.org
Various audio and video applications rely on multiple deep neural network (DNN) models
deployed on edge servers to conduct inference with ms-level latency service-level …

PIB: Prioritized information bottleneck framework for collaborative edge video analytics

Z Fang, S Hu, L Yang, Y Deng, X Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Collaborative edge sensing systems, particularly in collaborative perception systems in
autonomous driving, can significantly enhance tracking accuracy and reduce blind spots …

ChatIoT: Zero-code Generation of Trigger-action Based IoT Programs

Y Gao, K Xiao, F Li, W Xu, J Huang… - Proceedings of the ACM on …, 2024 - dl.acm.org
Trigger-Action Program (TAP) is a simple but powerful format to realize intelligent IoT
applications, especially in home automation scenarios. Existing trace-driven approaches …

Gecko: Resource-efficient and accurate queries in real-time video streams at the edge

L Wang, X Qu, J Wang, G Li, J Wan… - … -IEEE Conference on …, 2024 - ieeexplore.ieee.org
Surveillance cameras are ubiquitous nowadays and users' increasing needs for accessing
real-world information (eg, finding abandoned luggage) have urged object queries in real …