Large models are leveraged to distill functional rearrangement priors, improving object rearrangement tasks significantly.