The authors investigate privacy risks in utilizing Large Language Models with Federated Learning, revealing substantial vulnerabilities through theoretical analysis and practical experiments.