Enhancing Task-Oriented Dialogue Representations by Leveraging Large Language Models

A novel dialogue pre-training model called DivTOD that collaborates with large language models (LLMs) to learn diverse task-oriented dialogue representations by transferring rich general background knowledge and task-specific domain knowledge from LLMs to smaller models.