Bulk ingestion is slow AF

Is there any way around this? I have to drop around 2500 documents on Paperless on the first of every month. It takes between 6 and 12 hours to chug through it depending on how busy the server is.

For a workflow with some processes that are downstream of Paperless ingestion this is a real pain in the ass.

Anyone figured out how to speed this up besides just adding more celery workers (I've noticed diminishing returns after 3-4)?

reddit.com
u/BitOne2707 — 14 days ago
▲ 59 r/steak

Tomahawk

SV 2.5 hours @ 135.5 then finished on a 600F grill 90s per side.

Served with chimichurri.

u/BitOne2707 — 4 months ago

Decel influence operation subreddits

I've muted a lot of them for me personally but it doesn't change the fact that these exist and are inorganically pushing this content

Here is just the latest example - https://www.reddit.com/r/SECourses/

- Tens of thousands of "visitors"

- Mod is a clearly fake profile and makes 99% of the posts

- Most posts have 0 organic engagement

- Occasionally one makes it to the front page and gets thousands of likes/comments

I report obvious bot posts (regardless of being pro/anti AI) but what are we supposed to do when it's an entire bot subreddit?

reddit.com
u/BitOne2707 — 4 months ago