u/Hopyki

Need help migrating 600GB (90k files) to Proton Drive – Hitting API & folder limits with rclone/restic

Hi everyone,

I could really use some help. I'm in the process of completely de-Googling and have successfully exported everything from Google Photos to a local hard drive backup.

I have about 600GB of photos and videos. Currently, they are all sitting in a single folder, which amounts to over 90,000 files. My goal is to move all of this over to Proton Drive (either into a regular directory or directly into the Photos section).

Here is what I've tried so far:

  • I used rclone to try and sync the drive to a Proton Drive directory. However, I keep running into API rate limits and, most recently, Proton Drive's hard limit of 30,000 files per folder.
  • I then tried using restic + Proton to bypass the single-folder constraint and create a cleaner backup, but I ran into the exact same API errors and transfer failures.

I'm at a bit of a loss right now. I don't even know if Proton Photos can support this many files, or how to successfully execute a massive bulk upload directly into the Photos section.

Does anyone have any ideas or workarounds to solve this? :-(

Thanks in advance for your help!

reddit.com
u/Hopyki — 2 days ago