Achieving General Computer Control: CRADLE Framework in Red Dead Redemption II

The author proposes the General Computer Control (GCC) setting to build foundation agents capable of mastering any computer task, focusing on screen images as input and keyboard/mouse operations as output. The CRADLE framework aims to address challenges like multimodal observations, accurate control, memory requirements, and efficient exploration for GCC.