Tight Nonasymptotic Bounds on Relative Entropy Between Sampling With and Without Replacement

Sharp, nonasymptotic bounds are obtained for the relative entropy between the distributions of sampling with and without replacement from an urn with balls of c ≥ 2 colors. The bounds depend on the number of balls of each color in the urn.