
r/DataHoarder

130TB RAID 5 + hot spare
My previous system was a Synology 5-bay Running 5x12TB WD Reds in RAID 5. Lasted me almost 10 years. Hoping this one will last me till 2035.
My Mac just tried to read the entire internet before dinner
What happens if I just temporarily disconnected a striped drive.
Hey so just curious every now and then Ive needed to plug in a different 3.5 hdd but I've got two 12tb drives that's striped. If I unplug one. Does the drive disappear and can unplug in the new one without harn to the data on the striped drives.
A Prairie Home Companion - an Update on my 1980's collection
I am announcing that my collection of PHC programs for 1984 is complete. I have every show from that year available for download. In addition, I have recently added the show from November 15, 1980. It is a complete show and a rare find for that early in Garrison's career. My 1983 collection is complete as well. I'm missing only a handful of 1982 shows. I'm still missing many shows from 1981 and 1980, but I'm finding more all the time. I'm currently filling in the first half of 1985. My1986 and 1987 collections are complete, but some are partial shows. This is still a work in progress. And this project is getting nearer to completion. Soon I will have all currently available PHC shows, and they all eventually will be complete shows (well, almost all of them will be complete).
Here is the link to access and download the 1980's shows I have at this time:
https://www.mediafire.com/folder/ye4q8i98awequ/6+PHC+1980s+In-progress+Workshop
Please pay attention to how many files you can download in one batch. There is a limit set by MediaFire. Better to download fewer at a time. Don't be impatient. They will still be here.
Here are links to other eras of a Prairie Home Companion:
American Radio Company shows, 1989-1993:
https://www.mediafire.com/folder/8e9wl2spc1o99/2+ARC+-+Garrison's+American+Radio+Company+1989-1993
PHC Shows from 1993-1996:
https://www.mediafire.com/folder/kr26tp1lwpgqo/3+PHC+-+A+Prairie+Home+Companion
Shows in PHC Archive 1996-2016:
https://www.mediafire.com/folder/yes599ma1wov8/4+PHC+Archives+1996+to+2016+Unedited
PHC shows not in Garrison's PHC Archive:
https://www.mediafire.com/folder/cnlca8k8qbsjh/8+PHC+Shows+not+in+Archives
You are welcome to these files.
I made a video on why every server rack is exactly 19 inches wide — the real (non-Westinghouse) origin story
Got curious why every rack, everywhere, is the same width, and went down a rabbit hole. Turns out the popular "railroad relay shelving" origin story doesn't hold up — the real trail leads to an AT&T repeater redesign in the early 1920s, and nobody ever wrote down why they picked 19 inches. Facebook tried to replace it with OCP's 21" Open Rack in 2011 and found a niche in some AI deployments, but otherwise things didn't change.
Happy to answer questions on the sourcing — tried to keep it to primary documents where I could find them.
Concord Server Preservation Project: Are there any ongoing attempts or existing community findings?
Hi everyone,
I’ve been following the discussions around Concord and the current state of its servers. I’m interested in the technical side of game preservation and the possibility of local/community server emulation. Before diving deep into my own experiments, I wanted to reach out to this community to see if there is any collective progress I might have missed.
I’m looking for any information on the following:
Server-Side Research: Has anyone successfully managed to extract or map the server-side logic from the client binary files? I’m curious if anyone has identified the specific handshake protocols used by the PS5 client.
DNS/SSL Challenges: Many of us know that simple DNS redirection leads to SSL/TLS handshake failures. Has anyone tried to bypass these by injecting custom root certificates or using specialized proxy setups?
Data Dumps: Have there been any complete dumps of the game’s disc data, and has anyone attempted to decompile the network modules within those files?
Community Efforts: Are there any Discord groups, GitHub repositories, or forums where people are actively trying to build a 'Mock Server' or server emulator for Concord?
My goal is to consolidate existing knowledge and see what the community has discovered so far. I am not suggesting I have all the answers—I am here to learn from your findings and see if we can organize a more structured preservation effort.
If you’ve experimented with this, even if you failed or reached a dead end, please share your experiences. What were the specific error codes or roadblocks you encountered?
Let’s share what we know and see if the community can keep the game’s internal logic documented, even if the servers remain offline.
Thanks!
Good lord what have I done
So I discovered Heritrix. After compiling a list of 10k seed domains, I started my first crawl. The queue keeps growing. Send help.
What do yall think of this deal?
It also says it was tested with hard disk sentinel at 100% on all drives. I was thinking of doing an HBA controller for em. 28tb for $200 or less...
Zählt das noch als Homelab?
Angefangen hat das alles ganz harmlos mit einem Pi, einer Fritzbox und einem alten PC Dann kam ein „gebraucht ist das doch günstig” Angebot nach dem anderen und jetzt steht hier ein Schrank mit UDM Pro, UniFi 24er Switch, Supermicro Server (Haupt Proxmox), nem Fujitsu für (Test Proxmox)und noch einem JBOD mit 12x8TB weil „war halt billig“. Der Kram wurde zum Glück vor der Krise gekauft und zu echt guten Preisen. Kabelmanagement kommt noch, das Rack wurde gestern erst gekauft vorher stand alles lose auf dem Boden..
Idle sind’s ca. 600Watt. Bereue nichts. Fast.
should i keep both computers or get a drive encloser
So I originally started this hobby by turning this old 15-year-old Asus computer into a media server running Linux and Jellyfin. It only had 1 TB hard drive, and that filled quickly, so I ended up buying two 6 TB hard drives, and I have filled one. I was thinking of getting a 16 TB hard drive to be set for a couple of years, since now I've got most of my media that I wanted, and now it's just new stuff. And since drives keep going up like crazy.
So what started it was my Asus M11BB with an AMD A10 that had 32 GB DDR3L. it has enough to fit 4 drives in the case.
Later, I found a Dell OptiPlex 7070 SFF with an Intel i7 9700, with 16 GB DDR4 RAM for $50 at a thrift shop. but only has room for one drive
currently. I have 3 hdd in total, and my setup is having one in my Dell and running my full Docker stack on it, and then having the other 2 in my Asus.
I have my Jellyfin and other dockers running in my Dell, and in my Asus, I have only Immich, and have my drives docked through my network from my Asus to my Dell.
One issue I have been having with the Asus is that I have had it stall out multiple times, as it would be on, but when I try to SSH into it or access media from it. I would not be able to, and I would need to do a hard reset by holding the power button. And that's pretty annoying since I have some media in there that Jellyfin is trying to access, but can't or I can't SSH from it. It's fine right now since I'm home, but I will soon be going to college again and would like to leave my media server running so I can SSH into it while I'm away.
So I've been looking, and I have been seeing that there are drive bays or enclosures, not sure what the correct name is, but the ones that can hold hard drives, not NASes. I was thinking I could get one of those and put my hard drives in them and connect them to my Dell, and then retire my Asus, or should I just keep my Asus and find a way to deal with the random stalls?
If I should get an enclosure, which one would be good for my maybe 4 drives currently I have:
2x 6 TB WD Red Plus HDD, 1x 1 TB Toshiba HDD, and thinking of 1x 16 TB Seagate Iron Wolf.
TLDR. Should I get a hard drive enclosure and connect drives to Dell and retire the old Asus computer, or keep the old Asus computer as mainly a drive holder for my Dell and have both running?
Cataloging database
Just curious, has anybody ever built their own software to catalog their movie catalog on their NAS? I built software for my Plex server and I’m just curious as to if anybody else has done it and if not, is anybody interested in something like that?
Backblaze + rclone
So, I am looking into adding a non local option to my 3 external HDD setup (2 diff locations)
I got to backblaze as the best option for my case and I read that I could use rclone with it, but here is what's not clear.
So I have 2 PCs on 2 different locations. If I set rclone up on both PCs, can I access backblaze on both, just like a normal physical drive -except it's cloud? And I can just add the files I need, and then have it on the other PC once I travel back?
Is that how rclone works? Any better options than backblaze?
Help with data hoarding
Hello, I'm in the process becoming a hoarder on my NAS
I have used my emails for over 10 years to save just about everything.
I've been tediously doing it manually.
Was wondering if there's a tool or better way to download it all at once, like google takeout for photos.
Should I buy 8tb HDD for a new RAID while prices are inflated?
I'm a videographer.
My raid that is currently filled costs me $400 for 16 TB (4x4TB, lasted 3.5 years). Now it would cost me about $1400 to do 32TB with a new enclosure, mainly because hard drives are so expensive. I could make the investment now, knowing these prices would likely decrease eventually, or just get 4x 4 TB hard drives, spend less, and not dump the investment at the peak of inflated prices.
What say y'all?
Are there any photo management tools which can sift through a hard drive without knowing where specifically to look to drag out all photos on it?
Hello All, new person here. Thanks for having me. New to photo cataloguing too. I might have made a mistake yesterday. I impulse bought Excire Foto 2027 thinking it would be good for collating all my photos together, knowing I had them everywhere, but unfortunately I misinterpreted a youtube advert for it going on about FOR PEOPLE with photos everywhere, and knowing it had won an award recently, it being a well over £100 purchase.
Unfortunately on booting it up, I learnt you need to feed the folder locations in to get it working its magic and it wont accept 'my pc' or root c: directory, or root e: directory as options. Kind of defeats the purpose of why I bought it which is as per the title I've said here, of having it HUNT OUT my photos and put them together. Are you guys aware of any programs which scan a drive, specifically the top level of a drive be it directory or mypc supertop folder(so searches it all) and puts all the photos (or their images via internal linking) all in one location for easy seeing? [I will likely still make use of excire when I know where to grab the photos from, that software I ask you if something does exist, hope should tell me origin, wrong to assume right, so yes when its grabbed them together it still says where from on the drive].
Thanks All.
Waves: a native, open-source GUI for downloading your TIDAL library (built on Tidal-DL-NG)
Waves is a new, open source, native desktop app (macOS, Windows, Linux) for downloading music from your own TIDAL account. It's a GUI built on top of Tidal-DL-NG's engine, actively maintained now as Tidaler.
Tidal-DL-NG/Tidaler is a great application, but I was never fond of the GUI, and the developer made it clear that they personally didn't use the GUI (instead using CLI) so the interface would not be priority.
I built Waves from the ground up using Tidal-DL-NG's engine and mostly kept it the same, apart from some minor optimizations and security hardening. Waves is fundamentally still the same under the hood, but with one major difference; Waves is about giving users the best GUI experience possible, with the reliability of what already worked so well.
What Waves does day one:
- Download tracks, albums, playlists, mixes, videos, or a whole artist's discography, up to HiRes Lossless/TIDAL MAX and Dolby Atmos where available.
- Search everything from one bar, or paste a tidal.com link.
- Preview a full track before downloading it.
- Download music videos in different resolutions + watch without downloading using the in-app player.
- Plex-friendly library layout by default (
Artist/[Year] Album/Disc-Track. Artist - Title), customizable. - Duplicate-edition detection, with an option to merge the best tracklist and best quality per song.
- No telemetry, no analytics, no tracking. No unsolicited network calls except opt-in FFmpeg setup and an off-by-default update check.
- Fine tuned animations throughout the app to add to your enjoyment using it.
- Open source, AGPL-3.0.
This is my first public release, so I'd really appreciate anyone willing to test it, file issues, and give feedback. A star on the repo helps a lot, too! Please take the time to check out the readme, if you want to learn more about the application, why I made it, and who helped make Waves possible.
Repo: https://github.com/iamprivacy/Waves/
Disclaimer: Paid TIDAL plan required, downloads from your own account only. Independent project, not affiliated with TIDAL, and meant for personal educational purposes only.
WH deletes thousands of web pages about energy conservation as heatwave slams US
theverge.comAnyone tried to buy from thailand seagate factory straight?
Is it possible to do the above? haha. since im living so close to thailand. but i tried email them with no avail. distributor in my country is just hopeless can't even get larger than 10tb drives constantly. thinking to outsourcce from thailand since seagate got factory there?