Aligning Large Language Models with Reinforcement Learning while Preserving User Privacy

It is possible to align large language models with human preferences and feedback data while satisfying strong mathematical guarantees of differential privacy.