AdaDeep:A DNN hyperparameter optimization framework
Adadeep integrates the adaptive model compression problem with a DNN hyperparameter optimization framework, using reinforcement learning to achieve adaptive lightweight model architecture search.
Model Architecture Diagram:
Description: To address these challenges, we propose AdaDeep, an automated DNN compression framework that explores the trade-off between performance and resource constraints at a holistic system level. AdaDeep selects the most suitable combination of compression techniques and corresponding hyperparameters for a given DNN, layer-by-layer. Additionally, AdaDeep uncovers novel combinations of compression techniques. Evaluations show that AdaDeep achieves significant improvements in latency, energy efficiency, and storage blueuction in DNNs, while incurring negligible accuracy loss.