Deep learning system performance can be significantly impacted by overlooked server overheads, such as data processing and movement functions.