Large language models like GPT-4 can effectively provide feedback in programming education, addressing code errors but requiring further improvements.