The author argues that State Changes Matter (SCHEMA) for procedure planning in instructional videos, emphasizing the importance of representing steps as state changes and tracking state changes. They propose a structured state space approach using language descriptions aligned with visual observations.
State Changes Matter for Procedure Planning in Instructional Videos