AI RESEARCH
DPU or GPU for Accelerating Neural Networks Inference -- Why not both? Split CNN Inference
arXiv CS.CV
•
ArXi:2605.00174v1 Announce Type: cross Video and image streaming on edge devices requires low latency. To address this, Neural Networks (NNs) are widely used, and prior work mainly focuses on accelerating them with single hardware units such as Graphics Processing Units (GPUs), Field Programmable Gate Arrays (FPGAs), and Deep Learning Processing Units (DPUs). However, further reductions in latency can be observed by combining these units. In this paper, partitioning CNN inference across DPU and GPU (Split CNN Inference) is proposed.