
Deep dive into fine tuning a reranker using lora on Phi2 LLM
I tried doing ablation study to understand what layers, gradient norms contribute more to the reranking ability of the model
u/Hairy_Goose9089 — 14 days ago

I tried doing ablation study to understand what layers, gradient norms contribute more to the reranking ability of the model