Bifrost: End-to-End Evaluation and optimization of Reconfigurable DNN Accelerators

Stjerngren, A., Gibson, P. and Cano, J. (2022) Bifrost: End-to-End Evaluation and optimization of Reconfigurable DNN Accelerators. In: 2022 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), Singapore, 22-24 May 2022, pp. 288-299. ISBN 9781665459549 (doi: 10.1109/ISPASS55109.2022.00042)

[img] Text
274519.pdf - Accepted Version

4MB

Abstract

Reconfigurable accelerators for deep neural networks (DNNs) promise to improve performance such as inference latency. STONNE is the first cycle-accurate simulator for reconfigurable DNN inference accelerators which allows for the exploration of accelerator designs and configuration space. However, preparing models for evaluation and exploring configuration space in STONNE is a manual developer-time-consuming process, which is a barrier for research. This paper introduces Bifrost, an end-to-end framework for the evaluation and optimization of reconfigurable DNN inference accelerators. Bifrost operates as a frontend for STONNE and leverages the TVM deep learning compiler stack to parse models and automate offloading of accelerated computations. We discuss Bifrost’s advantages over STONNE and other tools, and evaluate the MAERI and SIGMA architectures using Bifrost. Additionally, Bifrost introduces a module leveraging AutoTVM to efficiently explore accelerator designs and datatlow mapping space to optimize performance. This is demonstrated by tuning the MAERI architecture and generating efficient datatlow mappings for AlexNet, obtaining an average speedup of 50× for the convolutional layers and 11× for the fully connected layers. Our code is available at www.github.com/gicLAB/bifrost.

Item Type:Conference Proceedings
Status:Published
Refereed:Yes
Glasgow Author(s) Enlighten ID:Cano Reyes, Dr Jose and Gibson, Mx Perry
Authors: Stjerngren, A., Gibson, P., and Cano, J.
College/School:College of Science and Engineering > School of Computing Science
ISBN:9781665459549
Published Online:27 June 2022
Copyright Holders:Copyright © 2022 IEEE
First Published:First published in 2022 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)
Publisher Policy:Reproduced in accordance with the publisher copyright policy

University Staff: Request a correction | Enlighten Editors: Update this record