DEFA proposes algorithm-architecture co-design for efficient MSDeformAttn acceleration through pruning and parallel processing.