u/Juicer-44

I have fine-tuned DINOv3 ViT-S/16 on around 32k 2D projection images and added an MLP regression head to predict femur failure load (Fmax). The pooled test R² looks okay, but when I plot predicted vs. actual values for one specimen at a time, DINO does not always capture the lesion-driven strength variation better than the CNN baseline. Sometimes it compresses the range or shifts the calibration. My train and validation R² are nearly perfect, which I suspect is because lesion variants from the same specimens appear in both train and validation. What would you recommend for better capturing local lesion effects?