I’m currently working in construction (civil / project engineering side, mostly data centers) and I’m in the middle of a Master’s in Data Analytics Engineering. My long term goal is to pivot into data engineering or at least a more technical data focused role within infrastructure or tech.
Right now my experience is mostly in R (data cleaning, regression, clustering, some ML basics) through school, plus real world exposure to project data, cost, schedules, and operations from my job. I also use Excel heavily and have some light exposure to Python but nothing deep yet.
I’m trying to figure out if I’m actually on the right path or if I’m missing key pieces.
From what I’ve seen, data engineering seems way more focused on Python, SQL, and data pipelines rather than analytics or modeling.
So a few questions:
> What skills are absolutely must haves to break into data engineering right now?
> Is R basically useless for this path compared to Python?
How important are tools like SQL, Spark, Airflow, or cloud (AWS/GCP) for entry level roles?
> With my background in construction and data centers, is there a realistic niche I can leverage or should I try to pivot completely?
> And honestly… how bad is the market right now for someone trying to break in?
I’m willing to put in the work, just want to make sure I’m focusing on the right things.
Appreciate any advice from people already in the field.