Efficient Execution of Irregular Dataflow Graphs

Download or read book Efficient Execution of Irregular Dataflow Graphs written by Nimish Shah and published by Springer Nature. This book was released on 2023-08-14 with total page 155 pages. Available in PDF, EPUB and Kindle. Book excerpt: This book focuses on the acceleration of emerging irregular sparse workloads, posed by novel artificial intelligent (AI) models and sparse linear algebra. Specifically, the book outlines several co-optimized hardware-software solutions for a highly promising class of emerging sparse AI models called Probabilistic Circuit (PC) and a similar sparse matrix workload for triangular linear systems (SpTRSV). The authors describe optimizations for the entire stack, targeting applications, compilation, hardware architecture and silicon implementation, resulting in orders of magnitude higher performance and energy-efficiency compared to the existing state-of-the-art solutions. Thus, this book provides important building blocks for the upcoming generation of edge AI platforms.