I got tired of RL agents "solving" inventory tasks in 10 minutes so i built a high-fidelity environment that actually breaks them.
I think most supply chain envs use flat demand, instant shipping, and zero noise. You train an agent and it "solves" the the environment instantly but then it just fails the the second it touches real-world volatility.
i spent the the last few months building this logistics suite because i wanted to see if a continuous-control agent could actually handle the the bullwhip effect. my PPO agents kept "starving" at hour 40. I realized I’d accidentally built a starvation trap where the the lead time is 24h but if the the agent tries to stay too lean to save on costs it just cant recover when a route severance spikes lead times to 150h.
I've open-sourced a 5,000-hour sample on hugging face if you want to play with the the telemetry or test some offline RL:https://huggingface.co/datasets/AIMindTeams/defense-logistics-stochastic-simulation
curious to hear how others are handling long-horizon planning when the the failure costs are 400x the the cost of holding inventory. how are you guys tuning your discount factors?