The article introduces PICO, a framework for accelerating CNN inference on mobile devices through pipeline cooperation. It addresses challenges in mapping CNN to devices and optimizing inference workload distribution. The framework features graph partition and many-to-many mapping algorithms, improving throughput by 1.8 ∼6.8× in experiments with Raspberry-Pi devices. Challenges include redundant calculations due to CNN properties and complex structures like DAGs.
לשפה אחרת
מתוכן המקור
arxiv.org
תובנות מפתח מזוקקות מ:
by Xiang Yang,Z... ב- arxiv.org 03-26-2024
https://arxiv.org/pdf/2206.08662.pdfשאלות מעמיקות