u/Pazigoo36

I was wondering if there is a proven technique that works for knowledge distillation in the context of time series forecasting.

I have been trying alignment in the latent space with the Frobenius norm of Gram matrices as alignment loss, but results are not that impressive so far.

Any recommendations? Thanks!

I was wondering if there is a proven technique that works for knowledge distillation in the context of time series forecasting.

I have been trying alignment in the latent space with the Frobenius norm of Gram matrices as alignment loss, but results are not that impressive so far.

Any recommendations? Thanks!