How to deploy it properly on cloud

Hello guys

Sorry for that long post but I need your help and expertise I am still learning

I have a very huge application that have these dockerized components

- Nodejs web app
- API application
- clickhouse
- neo4j
- posgresql
- redis
- Kafka
- minio s3
- zookeeper
- 3 different data prosessing containers

I used to deploy all that together on one vm that have 32gb ram and 8 cores along with 32 tb ssd storage, I know that this seems dump to do this but our applications where working with no problems till we decided to start collecting more data and processing more data so we need to have everything in place with no issues at all but to be honest idk what to search about in order to get the knowledge of how to deploy that correctly

I thought of having each thing on it's dedicated version of cloud like dedicated clickhouse cloud and so on but idk if that is the right thing or not

The architecture is built on easy horizontal scalability basis so the only problem is how to maximize the performance, deploy correctly and have the minimal cost

So please guys help me to figure this out and know what to do

reddit.com
u/ExternalFold801 — 4 days ago

How to deploy it properly on cloud

Hello guys

Sorry for that long post but I need your help and expertise I am still learning

I have a very huge application that have these dockerized components

- Nodejs web app
- API application
- clickhouse
- neo4j
- posgresql
- redis
- Kafka
- minio s3
- zookeeper
- 3 different data prosessing containers

I used to deploy all that together on one vm that have 32gb ram and 8 cores along with 32 tb ssd storage, I know that this seems dump to do this but our applications where working with no problems till we decided to start collecting more data and processing more data so we need to have everything in place with no issues at all but to be honest idk what to search about in order to get the knowledge of how to deploy that correctly

I thought of having each thing on it's dedicated version of cloud like dedicated clickhouse cloud and so on but idk if that is the right thing or not

The architecture is built on easy horizontal scalability basis so the only problem is how to maximize the performance, deploy correctly and have the minimal cost

So please guys help me to figure this out and know what to do

reddit.com
u/ExternalFold801 — 4 days ago
▲ 21 r/Cloud

How to properly deploy it on cloud

Hello guys

Sorry for that long post but I need your help and expertise I am still learning

I have a very huge application that have these dockerized components

- Nodejs web app
- API application
- clickhouse
- neo4j
- posgresql
- redis
- Kafka
- minio s3
- zookeeper
- 3 different data prosessing containers

I used to deploy all that together on one vm that have 32gb ram and 8 cores along with 32 tb ssd storage, I know that this seems dump to do this but our applications where working with no problems till we decided to start collecting more data and processing more data so we need to have everything in place with no issues at all but to be honest idk what to search about in order to get the knowledge of how to deploy that correctly

I thought of having each thing on it's dedicated version of cloud like dedicated clickhouse cloud and so on but idk if that is the right thing or not

The architecture is built on easy horizontal scalability basis so the only problem is how to maximize the performance, deploy correctly and have the minimal cost

So please guys help me to figure this out and know what to do

reddit.com
u/ExternalFold801 — 4 days ago
▲ 0 r/devops

How to deploy it on cloud

Hello guys

Sorry for that long post but I need your help and expertise I am still learning

I have a very huge application that have these dockerized components

- Nodejs web app
- API application
- clickhouse
- neo4j
- posgresql
- redis
- Kafka
- minio s3
- zookeeper
- 3 different data prosessing containers

I used to deploy all that together on one vm that have 32gb ram and 8 cores along with 32 tb ssd storage, I know that this seems dump to do this but our applications where working with no problems till we decided to start collecting more data and processing more data so we need to have everything in place with no issues at all but to be honest idk what to search about in order to get the knowledge of how to deploy that correctly

I thought of having each thing on it's dedicated version of cloud like dedicated clickhouse cloud and so on but idk if that is the right thing or not

The architecture is built on easy horizontal scalability basis so the only problem is how to maximize the performance, deploy correctly and have the minimal cost

So please guys help me to figure this out and know what to do

reddit.com
u/ExternalFold801 — 4 days ago