Model compression and acceleration for deep neural networks: The principles, progress, and challenges
In recent years, deep neural networks (DNNs) have received increased attention, have been
applied to different applications, and achieved dramatic accuracy improvements in many …
applied to different applications, and achieved dramatic accuracy improvements in many …
A survey of model compression and acceleration for deep neural networks
Deep neural networks (DNNs) have recently achieved great success in many visual
recognition tasks. However, existing deep neural network models are computationally …
recognition tasks. However, existing deep neural network models are computationally …
Tensor networks for dimensionality reduction and large-scale optimization: Part 1 low-rank tensor decompositions
Modern applications in engineering and data science are increasingly based on
multidimensional data of exceedingly high volume, variety, and structural richness …
multidimensional data of exceedingly high volume, variety, and structural richness …
Low-rank tensor networks for dimensionality reduction and large-scale optimization problems: Perspectives and challenges part 1
Machine learning and data mining algorithms are becoming increasingly important in
analyzing large volume, multi-relational and multi--modal datasets, which are often …
analyzing large volume, multi-relational and multi--modal datasets, which are often …
Structured transforms for small-footprint deep learning
V Sindhwani, T Sainath… - Advances in Neural …, 2015 - proceedings.neurips.cc
We consider the task of building compact deep learning pipelines suitable for deploymenton
storage and power constrained mobile devices. We propose a uni-fied framework to learn a …
storage and power constrained mobile devices. We propose a uni-fied framework to learn a …
A quantum-inspired approach to exploit turbulence structures
Understanding turbulence is key to our comprehension of many natural and technological
flow processes. At the heart of this phenomenon lies its intricate multiscale nature …
flow processes. At the heart of this phenomenon lies its intricate multiscale nature …
Online ensemble model compression using knowledge distillation
This paper presents a novel knowledge distillation based model compression framework
consisting of a student ensemble. It enables distillation of simultaneously learnt ensemble …
consisting of a student ensemble. It enables distillation of simultaneously learnt ensemble …
Tensor numerical methods for multidimensional PDEs: theoretical analysis and initial applications
BN Khoromskij - ESAIM: Proceedings and Surveys, 2015 - esaim-proc.org
We present a brief survey on the modern tensor numerical methods for multidimensional
stationary and time-dependent partial differential equations (PDEs). The guiding principle of …
stationary and time-dependent partial differential equations (PDEs). The guiding principle of …
Cross tensor approximation methods for compression and dimensionality reduction
Cross Tensor Approximation (CTA) is a generalization of Cross/skeleton matrix and CUR
Matrix Approximation (CMA) and is a suitable tool for fast low-rank tensor approximation. It …
Matrix Approximation (CMA) and is a suitable tool for fast low-rank tensor approximation. It …
Calculating vibrational spectra of molecules using tensor train decomposition
M Rakhuba, I Oseledets - The Journal of chemical physics, 2016 - pubs.aip.org
We propose a new algorithm for calculation of vibrational spectra of molecules using tensor
train decomposition. Under the assumption that eigenfunctions lie on a low-parametric …
train decomposition. Under the assumption that eigenfunctions lie on a low-parametric …