The proposed MCRanker framework generates diverse criteria from a virtual annotation team to improve the consistency and comprehensiveness of pointwise LLM rankers.