From Partially to Fully Unmatched Modalities as Negative Samples in Contrastive Learning

We introduce a curriculum for multimodal contrastive learning that treats partially-to-fully unmatched modality pairs as progressively harder negative samples, improving cross-modal representation quality.