Analyzing Sample Hardness in Data-Centric AI

The author presents a fine-grained taxonomy of hardness types and introduces the Hardness Characterization Analysis Toolkit (H-CAT) to evaluate different Hardness Characterization Methods (HCMs) comprehensively. The goal is to address the lack of consensus and quantitative evaluation in characterizing "hard" samples.