Large language models can introduce health equity harms, necessitating evaluation and mitigation strategies.