Crowdsourcing platforms require systematic methods to evaluate data quality and detect spamming behaviors in order to improve analysis performance and reduce biases in subsequent machine learning tasks.
