Optimised weight programming for analogue memory-based deep neural networks

التفاصيل البيبلوغرافية
العنوان: Optimised weight programming for analogue memory-based deep neural networks
المؤلفون: Charles Mackin, Malte J. Rasch, An Chen, Jonathan Timcheck, Robert L. Bruce, Ning Li, Pritish Narayanan, Stefano Ambrogio, Manuel Le Gallo, S. R. Nandakumar, Andrea Fasoli, Jose Luquin, Alexander Friz, Abu Sebastian, Hsinyu Tsai, Geoffrey W. Burr
المصدر: Nature Communications. 13
بيانات النشر: Springer Science and Business Media LLC, 2022.
سنة النشر: 2022
مصطلحات موضوعية: Multidisciplinary, Computers, General Physics and Astronomy, Neural Networks, Computer, General Chemistry, Software, General Biochemistry, Genetics and Molecular Biology
الوصف: Analogue memory-based deep neural networks provide energy-efficiency and per-area throughput gains relative to state-of-the-art digital counterparts such as graphics processing units. Recent advances focus largely on hardware-aware algorithmic training and improvements to circuits, architectures, and memory devices. Optimal translation of software-trained weights into analogue hardware weights—given the plethora of complex memory non-idealities—represents an equally important task. We report a generalised computational framework that automates the crafting of complex weight programming strategies to minimise accuracy degradations during inference, particularly over time. The framework is agnostic to network structure and generalises well across recurrent, convolutional, and transformer neural networks. As a highly flexible numerical heuristic, the approach accommodates arbitrary device-level complexity, making it potentially relevant for a variety of analogue memories. By quantifying the limit of achievable inference accuracy, it also enables analogue memory-based deep neural network accelerators to reach their full inference potential.
تدمد: 2041-1723
الوصول الحر: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::38c9878313b56d74b60e30f7cda7645fTest
https://doi.org/10.1038/s41467-022-31405-1Test
حقوق: OPEN
رقم الانضمام: edsair.doi.dedup.....38c9878313b56d74b60e30f7cda7645f
قاعدة البيانات: OpenAIRE