[Question] Confused about interpretability under model misspecification
Hi.
I’ve been told all the time since intro stat that all models are wrong but some are useful, but never about how what happens to interpretability when the model is wrong. (I trust the mathematical statisticians 100% with the mathematical details of what I’m about to ask, Im concerned more so about the practicalities. Forgive any errors in understanding for I am a noob).
Specifically, with likelihood based methods, suppose the distributional assumptions are wrong (I presume they always are because the world is too damn complicated for me to be able to specify them correctly), then (correct me if I’m wrong), the parameters in the model still converge to “something” under certain assumptions about the likelihood. This pseudo true parameter is the parameter that minimizes the KL-divergence between the true distribution and our assumed distribution. Also, under certain assumptions, it will be asymptotically normally distributed and it’s recommended to use the sandwich estimator of its variance.
For the sake of not fooling myself every-time I use a model, I will presume it is always the case that I am estimating a pseudo true parameter (diagnostics only go so far). How am I supposed to interpret this pseudo parameter? My estimators? regression betas and odds ratios? What do they mean now?
I understand that to deal with these problems there are other techniques like estimating equations and the like (I don’t understand that part of the theory yet). How to they help with this issue?
What are some practical alternatives ?
Thanks.