SmartControl: Flexible and Adaptive Text-to-Image Generation under Rough Visual Conditions

SmartControl is a novel text-to-image generation method that can adaptively handle situations where there are disagreements between visual conditions and text prompts, by predicting a local control scale map to relax the constraints in conflicting regions.