The Unreasonable Effectiveness of Greedy Algorithms in Multi-Armed Bandit with Many Arms

Greedy algorithms outperform UCB in many-armed bandit problems.