Efficient Multi-objective Neural Architecture Search

The author proposes a novel NAS algorithm that efficiently profiles the Pareto front across multiple devices with a single search run, addressing hardware constraints and diverse objectives. By leveraging hypernetworks and multiple gradient descent, the method outperforms existing MOO NAS methods.