Prompt Tuning for Taxonomic Open Set Classification: Enhancing Hierarchical Consistency in Vision-Language Models

ProTeCt, a novel prompt tuning technique, calibrates the hierarchical consistency of vision-language model predictions to enable taxonomic open set classification, where the classifier can make predictions at different levels of semantic granularity.