Datasets for data engineering projects

I want to find datasets for a data engineering project where i work with pyspark and sql in databricks. I want a dataset that challenges my data modelling skills and my pipeline creation skills. I tried kaggle, but i only keep getting a single csv file as a dataset. is there a dataset that has multiple csv files as data sources or something? i want to be able to perform all the data architecture creation by myself... Recommend any datasets that you know as well!

reddit.com
u/maximus5470 — 9 days ago
▲ 1 r/IELTS

Assistance with IELTS Reading section

I am someone who doesn't enjoy reading passages in general. Right now i have to prepare for ielts and i am practicing reading sections now. I am facing trouble when it comes to pin pointing information. I have tried skimming to understand the core essence of a passage and scanned for any possible words that can be the answer... Yet i still find it difficult to find the answers. They somehow end up behind some synonym of some word or the answer is present in a sentence which is indistinguishable from the options provided...

I would like some advice on how to crack this section. Right now i only see that practice is my only option. But i would want some helpful tips to make my preparation journey a tad easier

reddit.com
u/maximus5470 — 16 days ago

Why does my partner want to run away from our relationship

I am an M(21) and I've been in a healthy relationship with this girl F(20). We have meshed really well and even when our fights get serious and messy, we forgive each other and move on. Now she tells me that she feels like running away from this relationship coz I am too good for her.

I can think of 2 possible options when someone feels that their partner is too good for them...

  1. They accept and never lets go of them

  2. They think it's a trap and they try to run away from it

I want to know what could be the other reasons for this and I also would like to know how to comfort my partner in this sense such that she doesn't need to feel like running away?

reddit.com
u/maximus5470 — 1 month ago

Is data engineering job even worth grinding for in India?

I am a 4th year student in India and i decided to specialize in data engineering because it felt like my skills would mesh well with this job role. I am seeking for an internship role so that i can get some real world experience in data engineering.

From what i have observed everywhere is that ai is being integrated everywhere and AI engineers are growing. Naturally the amount of data will also increase so i believe that data engineering will be crucial too.

As i try to browse through various career pages, i only notice that data engineering posts are not that common and at the same time, when the role's available, they require work experience. Moreover, they require additional skills like RESTAPI, Nodejs, etc which seems to be very confusing (why would a data engineer need to work with creation of api endpoints?)

Can yall share your opinions? If there are any good internship roles available, i would love to join it

reddit.com
u/maximus5470 — 2 months ago