Large language models like ChatGPT can be compared to lossy text-compression algorithms, offering insights into their functioning and limitations.