u/Such_Ad1212

Hi all, I'm trying to use omlx with codex. It often crashes and shows reconnecting on codex when context reaches around 100k tokens, with output token generated >5000. I'm using q4 mlx models.

Is it oom error? My device is macbook 64gb ram, m5 pro.

Is this limit normal for 64gb ram device, or I have misconfigured anything?

​