HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling - Université Polytechnique des Hauts-de-France Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2022

HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling

Résumé

Dynamic neural networks (DyNNs) have become viable techniques to enable intelligence on resource-constrained edge devices while maintaining computational efficiency. In many cases, the implementation of DyNNs can be sub-optimal due to its underlying backbone architecture being developed at the design stage independent of both: (i) the dynamic computing features, e.g. early exiting, and (ii) the resource efficiency features of the underlying hardware, e.g., dynamic voltage and frequency scaling (DVFS). Addressing this, we present HADAS, a novel Hardware-Aware Dynamic Neural Architecture Search framework that realizes DyNN architectures whose backbone, early exiting features, and DVFS settings have been jointly optimized to maximize performance and resource efficiency. Our experiments using the CIFAR-100 dataset and a diverse set of edge computing platforms have seen HADAS dynamic models achieve up to 57% energy efficiency gains compared to the conventional dynamic ones while maintaining the desired level of accuracy scores. Our code is available at https://github.com/HalimaBouzidi/HADAS
Fichier principal
Vignette du fichier
HADAS.pdf (2.46 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03889087 , version 1 (07-12-2022)

Identifiants

  • HAL Id : hal-03889087 , version 1

Citer

Halima Bouzidi, Mohanad Odema, Hamza Ouarnouhgi, Mohammad Abdullah Al Faruque, Smail Niar. HADAS: Hardware-Aware Dynamic Neural Architecture Search for Edge Performance Scaling. 2022. ⟨hal-03889087⟩
14 Consultations
25 Téléchargements

Partager

Gmail Facebook X LinkedIn More