Automating cyber-attacks using Large Language Models can transform security operations, posing risks and requiring proactive preparation.