DoughNet: A Visual Predictive Model for Predicting Topological Changes in Deformable Object Manipulation

DoughNet is a Transformer-based visual predictive model that can infer the sequence of geometrical deformation and topological changes (such as splitting and merging) of an elastoplastic object, given a single RGB-D observation of its initial geometry and the planned manipulation actions.