Is Contrastive Distillation Enough for Learning Comprehensive 3D Representations?

arXiv:2412.08973v3 Announce Type: replace Abstract: Cross-modal contrastive distillation has recently been explored for learning effective 3D representations. However, existing methods focus primarily on modality-shared features, neglecting the modality-specific features during the pre-training pro…