Preprint

Attention Heatmap Drift in a Contrastively Pretrained Vision–Language Model: A Controlled Matched-Learning-Rate Comparison of Full Fine-Tuning and Low-Rank Adaptation featured image

Attention Heatmap Drift in a Contrastively Pretrained Vision–Language Model: A Controlled Matched-Learning-Rate Comparison of Full Fine-Tuning and Low-Rank Adaptation

A controlled matched-learning-rate study of CLIP attention heatmap drift under full fine-tuning and low-rank adaptation.

avatar
Ruize Xia
Read more