Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 to Improve Lexical Faithfulness and Vocabulary Accuracy
Control-DAG introduces constrained decoding algorithms for Directed Acyclic T5 (DA-T5), a non-autoregressive text generation model, to address key limitations such as frequent out-of-vocabulary errors and inability to faithfully generate entity names. The proposed methods incorporate lexical, vocabulary, and length constraints to significantly enhance DA-T5's performance on Task-Oriented Dialogue and Data-to-Text generation tasks.