Large Language Models can deliver cross-lingual multi-step reasoning by aligning parallel reasoning paths across languages through a self-consistent prompting mechanism.