u/Spidy__

PymParticles is an experimental neural compression system that combines a Transformer language model with arithmetic coding to compress individual files.

Instead of training on a large corpus, the model is intentionally overfitted to a single target file. By memorizing and modeling the file's unique byte-level patterns, the Transformer learns to predict the next byte with high confidence. These predictions are then converted into compact probability distributions and encoded using arithmetic coding.

Checkout the Repo Here