Training Data Influence: Quantifying the Impact of Individual Instances on Model Predictions

The core message of this article is to provide a comprehensive survey of training data influence analysis methods, which quantify the impact of individual training instances on model predictions. These methods help demystify the relationship between training data and model behavior in complex, overparameterized models.