Optimizing Latency Predictors for Neural Architecture Search

The author introduces a comprehensive suite of latency prediction tasks obtained through automated partitioning of hardware device sets and designs a general latency predictor that outperforms existing methods, improving latency prediction by up to 87.6% on the hardest tasks.