Vision Transformers

Attention Structural Change During CLIP Fine-Tuning: A Comparative Study of Full Fine-Tuning, LoRA, and Regularization featured image
CLIP

Attention Structural Change During CLIP Fine-Tuning: A Comparative Study of Full Fine-Tuning, LoRA, and Regularization

A structural analysis of how CLIP attention changes under full fine-tuning, LoRA, and regularization.

avatar
Xia Ruize
•
Read more