5G-advanced toward 6G: Past, present, and future
Since the start of 5G work in 3GPP in early 2016, tremendous progress has been made in
both standardization and commercial deployments. 3GPP is now entering the second phase …
both standardization and commercial deployments. 3GPP is now entering the second phase …
Environmental sustainability and AI in radiology: a double-edged sword
According to the World Health Organization, climate change is the single biggest health
threat facing humanity. The global health care system, including medical imaging, must …
threat facing humanity. The global health care system, including medical imaging, must …
Reusing deep learning models: Challenges and directions in software engineering
Deep neural networks (DNNs) achieve state-of-the-art performance in many areas, including
computer vision, system configuration, and question-answering. However, DNNs are …
computer vision, system configuration, and question-answering. However, DNNs are …
Compute-efficient deep learning: Algorithmic trends and opportunities
BR Bartoldson, B Kailkhura, D Blalock - Journal of Machine Learning …, 2023 - jmlr.org
Although deep learning has made great progress in recent years, the exploding economic
and environmental costs of training neural networks are becoming unsustainable. To …
and environmental costs of training neural networks are becoming unsustainable. To …
Dynamic GPU power capping with online performance tracing for energy efficient GPU computing using DEPO tool
GPU accelerators have become essential to the recent advance in computational power of
high-performance computing (HPC) systems. Current HPC systems' reaching an …
high-performance computing (HPC) systems. Current HPC systems' reaching an …
Fusionai: Decentralized training and deploying llms with massive consumer-level gpus
The rapid growth of memory and computation requirements of large language models
(LLMs) has outpaced the development of hardware, hindering people who lack large-scale …
(LLMs) has outpaced the development of hardware, hindering people who lack large-scale …
Cost-effective on-device continual learning over memory hierarchy with Miro
Continual learning (CL) trains NN models incrementally from a continuous stream of tasks.
To remember previously learned knowledge, prior studies store old samples over a memory …
To remember previously learned knowledge, prior studies store old samples over a memory …
{EnvPipe}: Performance-preserving {DNN} training framework for saving energy
Energy saving is a crucial mission for data center providers. Among many services, DNN
training and inference are significant contributors to energy consumption. This work focuses …
training and inference are significant contributors to energy consumption. This work focuses …
Towards improved power management in cloud gpus
As modern server GPUs are increasingly power intensive, better power management
mechanisms can significantly reduce the power consumption, capital costs, and carbon …
mechanisms can significantly reduce the power consumption, capital costs, and carbon …
DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference
Due to limited resources on edge and different characteristics of deep neural network (DNN)
models, it is a big challenge to optimize DNN inference performance in terms of energy …
models, it is a big challenge to optimize DNN inference performance in terms of energy …