Core Concepts
State Changes Matter for Procedure Planning in Instructional Videos
Stats
"Our proposed SCHEMA model achieves state-of-the-art performance and obtains explainable visualizations."
"The success of state changes modeling motivates us to investigate the causal relations between steps and states for procedure planning."
"Recent works succeeded in sequence modeling of steps with only sequence-level annotations accessible during training."
Quotes
"We study the problem of procedure planning in instructional videos, which aims to make a goal-oriented sequence of action steps given partial visual state observations."
"We aim to establish a more structured state space by investigating the causal relations between steps and states in procedures."
"Our main contributions are summarized as follows: We pointed out that State CHangEs MAtter (SCHEMA) for procedure planning in instructional videos."