Matched-Learning-Rate Analysis of Attention Drift and Transfer Retention in Fine-Tuned CLIP
An 80-run matched-learning-rate study of CLIP attention drift, LoRA, and zero-shot transfer retention.
CLIP Attention Analysis
Training scripts and analysis code for an 80-run matched-learning-rate study of CLIP attention drift under full fine-tuning and LoRA.
•
1 min read
Read more