▲ 9 r/oMLX
Memory leak? High usage when models unloaded
After using OMLx for a few hours, memory usage seems to get stuck around 66GB (my hard limit is 102GB).
Even after unloading all models. Is this a bug or a misconfiguration on my part?
The only solution is to restart the server which is not practical when I'm away from home.
u/That-Desk-1552 — 2 days ago