The department of air-powered land vehicles: fan car evolution.
Original content btw, haha.
Original content btw, haha.
Scarecrow (DC Comics)
I was selling a tractor for my dad, listing it for 10.5K firm on the marketplace. The pricing was good and all that. Also I listed it onto Craigslist (yeah, you heard that right).
So on FB it was the usual "dumpster fire" experience: people offering trades despite the description saying no about that, people offering offers anywhere between 25 - 70% of the asking price. "Will you trade with my pontoon boat?" etc, you know what I mean. About 40 messages in total in the 1-2 week period with nothing proper. One guy looked at it irl from FB. Thousands of views.
And then on Craigslist during this period there were 2 messages, with the second one being a guy who bought it at full price.
So yeah, I sold things on FB before, but expensive things just aren't one of them, lol. I thought this particular situation kind of funny.
My most popular and oldest tar pit, gladeart (DOT) com/data-export has done over 30 million serves to bots in total, as of now. Gzip bomb pages like gladeart (DOT) com/saturn_strike are cool, but they just aren't popular among bot swarms because they aren't good for crawling. And that is why I came up with a solution:
When the pit hits over 2000 global RPMs, it becomes a gzip bomber, sending gzip bombs which are small for the server to upload, but very large to decompress. Under 2000 RPMs it functions normally as it has before. This new update just rolled out today.
It's just ideal because it's attractive to bots due to the attractive text in the tar pit, but then it switches to a gzip bomber for the next minute. And best of all, this happens during busy hours because of its mechanism.
Be careful if you go onto there as it may be busy and gzip bomb you, potentially causing the tab to crash. Btw, scraping some random site like this at 2000 requests per minute while rotating IPs aggressively to avoid rate-limiting is not respectful at all by any means, and they are also not listening to the robots.txt which explicitly disallows them from going into the pits. So I would consider these as bad bots that deserve to be gzip striked.
Thanks for reading!
I'll give some more in-depth explaining with logs for download some time later when I find time. Here is a brief overview:
Data Export: https://gladeart.com/go/1782206295304iqFGnniuHtrXcLK2Lm805PY192J4-eVKm1whPOLrE_8 Over 25 million requests.
CodeHub: https://gladeart.com/go/17822063520736wujurWFhgOVMO1vARHD7uO5RBdfjo5jNmhyBmzf1kM Over 5 million requests.
Hashtree: https://gladeart.com/go/17822063792636gJKw39Oj3_I89i5KDPq9EHOcmqUMtwhmb5r0Ys8Jsw Over 10K requests.
GRO: https://gladeart.com/go/17822064210998oi9VNqgj0e9iUcy4xxdsTU1AKY49wgjBjHRWiJcegU Over 1.5 million requests.
Misinformation Machine: https://gladeart.com/go/1782206450160UQEdN3KmlqQzB6r3OBTxDa1GF713hoMfQ-cLg2Ta_TM Over 1 million requests.
Saturn Strike: https://gladeart.com/go/1782206476517i7vxjqCH-bxFSJWmWbDrVv-Az8D01fy2z0d4nUeeXo4 Over 100K requests. WARNING: this one is a gzip bomber, your tab/browser may crash when opening it up.
Note: Saturn Strike on its own isn't very attractive for crawling. The 100K + requests are mostly from when I replaced the Data Export pit endpoints with Saturn Strike during busy hours, lol. These links are protected by the Glade Art PoW link protector to curb bot crawling of them. They are set to expire in 1 month btw.
Thanks for reading!
Yeah so we RCers use these kind of fans for cooling off the motors and ESCs of RC cars. They're made for brutal air-flow and durability, not for efficiency or quietness. And these little beasts use up a lot of power, way too much for the Pi's board.
The CPU temp results:
~49c stabilized under long, max load.
I think a larger heat-sink would make a big difference, as this one is very tiny. I probably wouldn't recommend this kind of fan because they vibrate a lot, that might be a problem for the Pi over time.
With the current malware problem.
When we have a tar pit on our sites, we often disallow bots from going into there in the robots.txt. Bad bots don't care, while good bots like search engine crawlers, e.g. Googlebot or Bingbot, respect the rules. Sometimes the reason why bad bots go into there in the first place is because it's disallowed in the robots.txt. But anyways, if your website isn't indexed by search engines, it's completely ethical to not disallow bots from going into the tar pit imo.
I never required them bots to use my site, and I never told them to stay on it. I never asked for bot swarms like these to exist in the first place.
Imma remove the robots.txt from my tar pit sites which aren't indexed on Google altogether.
A fine addition to my collection: https://hatehub.net/racket/232e323
I just needed to drop it here so that it gets crawled, sorry about that!
You know what that is, and I'm going to be installing libreELEC on my current Raspberry Pi for the smooth-like-butter media playback.
Not really a modeler; I'm an animator for fun. I reuse the same models most of the time, so this 'workflow' isn't a problem for me to 'model' a model every once in a while when I need it.
4000 RPMs is the global cap for this specific tar pit. I already posted about it, so I don't want to repost; you can read that Reddit post here.
I just managed to get a video of an actually busy time in the pit, lol. It can literally go like this all day and all night, and that's how we have 14 million requests in that pit now. (Been about a million each day since the start of June).
I did a post on here a few months ago about 6.8 million requests in the same bot tar pit. Well now that's 13.7 million as of the time of writing this. When the blog article was written though, it had 10 million.
Apparently I had the global rate-limit set too low for a month, so it was slow moving. I have no idea why or what I did that for, but then I forgot all about it, lol. Perhaps I was screwing around with the code while having a fever? Anyways, it has been raised to 4000 RPMs globally some days ago. And since the blog article was published, there have been about a million each day.
I have a bunch of other popular tar pits at this point on other domains and stuff, but this one is still the most famous in the bot worlds. Technically we can say that Glade Art has 2 million monthly visitors on average. /s
Thanks for reading!
Solid viewport mode, hence no actual textures. (Just a really lightweight texture preview). OC, Blender.
So yeah, 10 feet tall is already quite huge, but 12 feet is even more massive.
For reference, the knee hinge joints are as big around as the person's waist.
10 million requests hit in my oldest and most popular tar pit! Last month was kind of slow moving, and we were stuck on 9m for a while, but they picked back up again. (It's over 11m now btw; got 1m more in the past few days).
Here is a blog article giving some more information about the bot behaviours, log files for download, and such:
https://gladeart.com/blog/10-million-requests-in-my-bot-black-hole-here-is-some-information
This pit in particular: https://gladeart.com/data-export btw.
Thanks for reading!
Such a good movie. I thoroughly enjoyed it on the first time, and every re-watch.
You may know about Anubis by Techaro, the PoW challenge thing that protects websites from bots. It's used on several major sites, including FFmpeg, Arch, and the Linux Foundation. This experiment is specifically about Anubis.
Note that Anubis does not use up all CPU cores for its challenge to not overheat devices and for a better UX. Some PoW challenge systems do all cores, making them more effective. However, it appears as if Anubis gets the job done just fine.
Bot swarms operate at such insane scales, that almost none of them even execute JS (JavaScript), let alone solving PoW (proof of work) challenges (as seen in my tar pits which have almost 10 million total serves and other projects). Old Reddit doesn't require JS to function, so this makes it a large target for heavy swarms. The same applies to many forums. So if you need to share a link and you don't want that link crawled, you can use this protector. 100% free and no ads. It doesn't mine crypto.
Here is an example protected link: https://gladeart.com/go/1778419316391ToEmcwrie-Nn777xytJTMQUoqXnwCkjParVEgfSESXs
Here is an explanation of this protector: https://gladeart.com/blog/the-glade-art-pow-link-protector-what-it-is-and-why-you-should-use-it-to-prevent-bots-from-crawling-your-links
(Blog has no ads btw; none of Glade Art does).
While the uses of this tool are quite niche, there are some useful ones. Perhaps one of you guys will use it for something useful too.
Thanks for reading!
Calf century actually. Gym-goers know why.
(Blender).
After almost 10 million requests in the past few months, the Glade Art tar pits seem to be slowing down for now. Perhaps they detected that the dozens of tar pit endpoints are endless or perhaps they started "blacklisting" the site. By slow I mean only about 10 requests per minute on average now. Either way, there is always a new bot swarm that arises later when things seem to slow down.
But anyways, I had a spare domain laying around unused, so what would be better than to create a dedicated tar pit site with it? And so a few weeks ago I deployed it. See it here: https://gladeart.com/go/1778469735274zGESWbV6i7pR-dPl7luNKr8Ls68jVuaiQ_NzhojhXdg
(Protected by the Glade Art PoW link protector).
So yeah, this site is a massive slop pit. Special thanks to the Poison Fountain as this uses some of its generated data for it. The site has been gaining traction and is currently my most trending tar pit. (Not of all time; only as of now).
The bots originally discovered it because I set up a redirect on one of the Glade Art tar pits to this site. I removed it now to not degrade its percieved value, and they continue coming to it as it must be in their database already.
Logs releasing soon once we hit 1 million requests in this new site, so stay tuned!
Glade Art tar pit #3 source code: https://doggydogdog.xyz:8443/glade_art/gro-tar-pit-text-generator
This new site's source code: https://doggydogdog.xyz:8443/glade_art/dedicated-tarpit-honeypot-bot-trap-site-source-code