A proximal policy optimization (PPO) based framework that effectively manages residential solar energy to maximize profits in a dynamic electricity market.