A Comprehensive Guide to Interpreting Feature Importance Methods for Scientific Inference

Feature importance methods can provide useful insights into the data-generating process under certain conditions, but the results of different methods have different interpretations. This paper serves as a comprehensive guide to help understand the different interpretations of feature importance methods and formulate concrete recommendations for scientific inference.