u/BlueCeAnd

Real-time neural weather restyling for Minecraft on a GTX 1650 (1.4M-param U-Net, distilled from FLUX.2 klein, 30-40 FPS realtime on budget GPU) [P]

  • Teacher: FLUX.2 klein 4B paints ~3k frames (snow / wet / night at 3 strengths).
  • Student: 1.4M-param U-Net with FiLM sliders, 512×288, ~26 ms/frame via ONNX Runtime inside a Fabric mod; the HUD stays untouched.
  • Pixel loss (L1+MSE) gave a washed-out “average” because the teacher places snow/puddles differently per frame. A PatchGAN fine-tune on the same pairs fixed it: fat snow, real-looking reflections.
  • Failure cases: night (teacher painted sunsets), already-snowy biomes (never in the training data).

Happy to share details.

u/BlueCeAnd — 5 days ago