ChatGPT generates text by predicting reasonable continuations based on vast text data, using a probabilistic approach with controlled randomness to enhance creativity.