R+R: Understanding Hyperparameter Effects in Differentially Private Stochastic Gradient Descent (DP-SGD) - A Replication Study
While learning rate and clipping threshold demonstrate a strong, replicable interaction effect on model accuracy in DP-SGD, the influence of batch size and number of epochs remains inconclusive and inconsistent across datasets and tasks.