Symphony: Optimized DNN Model Serving using Deferred Batch Scheduling

Deferred batch scheduling optimizes DNN model serving efficiency and throughput in Symphony.