Image 1 — time for a zpool scrub
Image 2 — time for a zpool scrub

time for a zpool scrub

I finally finished upgrading my home server the other day. The old ddr3 hardware was showing its age. Now I have a ddr4 system with a 22 core xeon and room to add a second cpu. I split 8 of my disk drives into 2 separate zpools, and another 2 disk drives in a mirror, and 3 more ssd's for the host os, vm's, and my software development workspaces.

I don't have a 10 gigabit switch yet, so for now, I have a dedicated 10 gigabit link directly to my desktop. File transfers barely go faster than 1 gigabit, cuz my desktop is so old. But, I just started a scrub on all 3 zpools, and I've seen it hit 3.7 gigabytes per second. Having some fun playing with things.

blinky lights: https://www.youtube.com/shorts/JqljnZZ45Zo

I built this wooden cabinet about 20 years ago, to have a high voltage ion air filter built in. You'd think having a bunch of aluminum plates charged to thousands of volts, and occasionally sparking, this could be a bad idea to have near expensive computer equipment. I've never had a problem with it, works great. But, I took it apart a few years ago and never finished rebuilding it. I used to put cd's inside the cabinet facing up, and they would still be clean years later.

fyi, I have dusted everything well since that photo was taken. Gotta get the ion filters going again.

The UPS is a new/old stock 1000va Eaton double conversion UPS, which I got a great deal on. It came in the mail with the batteries already connected. Who knows how long it was sitting in the box like that, but probably 4 years later now, I am still using the same original batteries. But, I have added 2 more sets of batteries on the side, and they are all starting to show their age. I still get more than 30 minutes of run time at half load, running my desktop and server and network equipment and everything. I do love double conversion. It will take any kind of dirty power and give you a nice clean power. I found it will even take 60 volts from the wall and boost it right up to 120 without using the battery. At 55 volts, it will switch over to battery. Neat stuff.

u/lorenzo1142 — 12 days ago

google bot pretending to be a lot of other bots?

I'm watching my web server logs tonight, looking for any bots abusing things. here's something new I've never seen before, google bots pretending to be all kinds of other bots, and 100-200 requests within only a few seconds.

it came from 2 different google IP addresses, first 211 requests within 16 seconds, then a half hour later 131 more requests within 3 seconds. the agent for these requests say Bravebot, GrokBot, DeepSeekBot, Kimi-SearchBot, YouBot, YiBot, Amazonbot, PanguBot, MoonshotBot.... and many others.

it's unlike google to send this many requests within such a short time. could it be some google AI bot going crazy?

reddit.com
u/lorenzo1142 — 14 days ago

SchematicsForFree.com torrent, does anyone want?

does anyone here use SchematicsForFree .com ? the reliability of the website has been lacking this year, and I know some people want a copy of all the files, so I made a torrent of the entire collection. when more content gets added, I'll make a new torrent. the torrent is available for free on the website, it just needs some seeders.

it's a little more than 50 gigs

reddit.com
u/lorenzo1142 — 1 month ago
▲ 22 r/MinecraftPlugins+1 crossposts

r/minecraftplugins

This subreddit needs proper moderation. I have been trying to contact the mods for the last 3 years. The subreddit is now being spammed with "server finder" and no mods are around to do anything about it.

I would love to help revitalize this subreddit.

reddit.com
u/lorenzo1142 — 2 months ago

old server failing, time to upgrade

I have a 15 year old supermicro 2U server, which I bought used and have been using for the last 10 or so years. I seem to be having some hardware failure, so it's time for upgrades.

I'm planning to keep the same CSE-825 case and swap out the motherboard. I'm thinking probably LGA2011 socket with dual cpu support. start with a single cpu and have the option to expand later. my budget is around $300 for used hardware.

I'm planning a new backrooms minecraft server, but will probably use folia, so it might be better to go with more cpu cores instead of faster per core. I do run other things on the same server, but minecraft is the biggest resource demand. the worlds are huge and players spread out, so folia should be perfect for this, with plenty of cpu cores.

maybe 16+ cores at 2.3Ghz base would be the best option for me? I'm looking for the best value, and still good performance. once I pick a cpu, I have to find the right motherboard to fit my needs. I would definitely like to stick with supermicro.

I will need to replace my old ddr3 ram with ddr4, 16 gig ecc sticks. and a new HBA card, probably either 9300 or 9400, something under $100 used. I don't need sas, I only have sata drives with a sata backplane.

I'm in need of some guidance and suggestions. everything follows the cpu, so I don't want to make a mistake from the starting point.

---

if you care to know how my last 2 weeks have been:

I finally switched to fiber internet tuesday of last week. I have had nothing but problems with my server ever since. before this, I was going on a full year of uptime. server couldn't get an IP from my internet provider. finally figured out the dumb mistake I was making after a week. network is working, next problem...

my 30TB zpool somehow got corrupted. after rebooting it somehow freed up 800 gigs, I think just some removed snapshots that failed to free up space. that's fine, but now every time I try to write to the zpool it causes some weird sync error, the kernel hangs, and the zpool itself goes suspended. I think importing the zpool as read only seems to be stable, so I'm hoping can still recover from this.

there are no disk checksum errors. smart says all the drives are good. I've ruled out problems with the old HBA cards, the backplane, the drives, cables, power supplies, ram, heat, kernel and zfs versions.... I've even tried the latest bleeding edge kernel and zfs versions, always the same problem, zpool goes suspended and kernel hangs.

so I've disconnected the disk drives for now and running only on an ssd connected to the onboard sata. yesterday it hung again.... okay, so maybe the onboard sata is the problem? so now I have the ssd connected to a HBA card. I look over just now and it hung again.

at the moment I'm using a small fanless computer as a temporary server to get back online. I run opnsense in a vm. last night, that fanless computer crashed with IO errors..... that has never happened before and I have no idea why it crashed. is the government blasting me with microwaves or something??

it seems likely to be a zfs bug. but, I would still like to upgrade my dated hardware.

reddit.com
u/lorenzo1142 — 3 months ago
▲ 3 r/dev

Making my own package manager

I need to make some custom packages for my servers and containers, for a few different distros. I've grown tired of fighting with all the different tools and the special ways they do things... Fine, I'll make yet another standard to rule all standards!..

My goal is to Keep It Simple Stupid. I don't want custom binary formats or 1000 line spec files or a special package for each distro... Just keep it simple.

A package is a zstd compressed tar with a json metadata file and the payload. The package repositories are indexed and stored as json in a normal package. Can't get much simpler than that. Fetch the latest index package and the cache is all up to date.

Creating a package, indexing packages, and installing/updating packages, all done with the same tool. One package should work on any linux distro, and it works along side existing package managers.

It's not finished, but I've gotten a lot done, and it's about ready to start testing before production use. I'm starting out using it in docker as install only, no updating. Next I will add support for tracking of installed packages and updating, and dependencies and all that. I made it in golang and wrote all the code myself. It will be released as AGPL open source.

What do you think, sound useful?

reddit.com
u/lorenzo1142 — 4 months ago

making a package manager in golang

I want to make my own package manager for linux, in golang. Anyone want to help or even just chat about it?

I've been researching the topic for about a week. I'm still fuzzy on how some things should work. Here's what I plan so far:

A package will be a zstd compressed tar archive, with a file extension of box, or maybe bocks. Inside it will be a json file for metadata, a file for signing, and the payload files to be installed. The payload files don't need to be in any specific directory path, they can be wherever is convenient for development. The final path is decided by the json metadata at the time of actual install.

The package repository index will be a package itself, containing an index.json file, with searchable fields. When you want to install a new package repo, or when the package manager wants to update the cached index, it's as simple as downloading the index package and installing or updating it in the local system.

My goal is, Keep It Simple Stupid. I need to make packages for a few different types of systems, and I'm tired of fighting with spec files and abuild and whatever else. I just want a simple package manager which I can use along side whatever the distro uses by default.

Sound interesting? Want to help or chat about it?

reddit.com
u/lorenzo1142 — 5 months ago