Language Models as Compilers: Simulating Pseudocode Execution Improves Algorithmic Reasoning in Language Models

Decomposing the reasoning process of language models into two steps - THINK to discover task-level logic expressed in pseudocode, and EXECUTE to tailor the pseudocode and simulate its execution - can significantly improve their performance on various algorithmic reasoning tasks.