Traditionally, neural network inferencing on tiny hardware devices took place in a
centralized server-based manner. With more real-time applications coming into play, where …