u/Consistent_Tutor_597

Hey guys. Most of our stuff ran in cron before. And I decided to make things more reliable. So I setup self hosted airflow in docker etc. But it's been quite a pain. It keeps getting stuck every few days silently due to one or the other random reason every time.

I was using external python operator before inside the same docker as the scheduler. But then I it got stuck in hangups etc and I thought that's the issue so I did it in a more fancy way with 4-5 containers celery, redis, scheduler etc in separate containers. And even today it got stuck on one job randomly. I was on airflow 3.0.0 before though we upgraded it to 3.2.x or something today to see if that helps. But it's been a bit of a fight. That I am starting to get a bit tired.

I had hoped that it being the industry standard and all it would be super smooth a perfect but it's been a bit of a pain in the ass. I am not sure if it's airflow itself that's at fault or am I doing something wrong. I am not an airflow expert and working with ai on it. So I might be missing something. But it has not been a smooth experience and I am considering just using cron, or potentially dagster. But let me know what you guys think. Maybe a managed solution is better but I would like if it's something we can stay on free tier of. As it's a pretty shit dumb low reliability job that cron can almost take over with 0 reliability issues.

Let me know what you guys suggest and if I am doing something wrong. Thanks 🙏🏻

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys. I have had to do some infra duties as there's no one else available and I have been doing pg dump, pg restore for our postgres and just a pure rsync for server backups. Running through a cron. I know there's other cli tools exist like pgbackrest and borg.

But was wondering if there's something that gives you a dashboard of sorts. Where it's like one click scheduled backup jobs u set a retention policy, see existing backups (delete if needed) and one click restores as well for drive and db. It would be way more convenient. And you can point it to your own s3 or something.

I was considering managed postgres for us but I realised setting up postgres in a docker is dead easy. It's mainly backups and restore that I wanted to pay cloud for. So maybe if there's some tool out there that does that reliably, would be great. Either open source self hostable or paid with a reasonable sub fees. I was looking around and found databasus and snapshooter by digital ocean. But maybe something better out there. Thanks.

Hey guys, can you take backups longer than 7d in supabase at an extra cost? On the pro plan. I know there's pitr. But that's too expensive and not what we need. I just need daily backups but upto 30d or more. Is that available as an add on? Otherwise would just pg dump work? And will it burn through my given egress if larger db taking daily backups.

Hey guys I need help. I am shipping a public monetized api. And how should url be structured out of these.

/v1/property?fields=risk.bushfire,market.sale.price

/v1/property/risk?fields=bushfire

/v1/property/risk/bushfire

problem is. They will have to make requests indvidually if they want all risks. Plan is to make my own site use that same api too. And hence instead of just 1 db query sending all risks. It will have 5 queries. How to best structure it. For a whole report on a property it will be massive amount of api calls.

Hey guys I need help. I am shipping a public monetized api. And how should url be structured out of these.

/v1/property?fields=risk.bushfire,market.sale_price

/v1/property/risk?fields=bushfire

/v1/property/risk/bushfire

problem is. They will have to make requests indvidually if they want all risks. Plan is to make my own site use that same api too. And hence instead of just 1 db query sending all risks. It will have 5 queries. How to best structure it. For a whole report on a property it will be massive amount of api calls.

Hey guys I need help. I am shipping a public monetized api. And how should url be structured out of these.

```/v1/property?fields=risk.bushfire,market.sale_price

/v1/property/risk?fields=bushfire

/v1/property/risk/bushfire```

problem is. They will have to make requests indvidually if they want all risks. Plan is to make my own site use that same api too. And hence instead of just 1 db query sending all risks. It will have 5 queries. How to best structure it. For a whole report on a property it will be massive amount of api calls.

​

Hey guys. I am planning to launch a public api. Is it fine to self manage api keys in our own endpoints and storing hashed in our db?

Or is it better to use a platform like unkey. I don't understand why it's there as issuing api keys and storing them does not sound like a problem u need a saas for unless you are in multi nodes maybe. But am I missing something?

Hey guys, is there something wrong with it. In an async or even sync way. I heard stripe metered billing handles >10k event/s now. Is there any need to use a third party tool like openmeter?

Hey guys, is there something wrong with it. In an async or even sync way. I heard stripe metered billing handles >10k event/s now. Is there any need to use a third party tool like openmeter?