LLM Safety Enhancement through Constrained Direct Preference Optimization

Constrained DPO (C-DPO) enhances LLM safety efficiently and effectively.