r/dataengineeringjobs

Need career advice Is it too late to switch to Data Engineering?

Hi everyone,

I need some career advice.

I've been working at the same company for the last 7 years (currently earning 18 LPA). The biggest challenge is that the company uses its own in-house technology, which isn't really useful outside the organization. The only transferable skill I've gained is SQL, and I'd say I'm quite comfortable with it.

About 3 years ago, I decided to switch to a data-related career. After doing some research, I chose Data Engineering because it seemed like a good fit. I enrolled in a Data Engineering course from Scholarnest Academy, completed it on time, and prepared for interviews.

Unfortunately, a serious medical emergency in my family happened around the same time, so I had to put my plans on hold and never got the chance to attend interviews.

Things are stable now, and I'm preparing for a job switch again. Before I invest the next few months into interview preparation, I wanted to ask people who are already in the industry:

  • Is Data Engineering still a good career choice in 2026?
  • Is the demand still strong for someone trying to break into the field?
  • Or would you recommend considering another role instead?

For context, I have strong SQL skills and I'm currently brushing up on Python, Spark, Databricks, and cloud concepts.

I'd really appreciate any honest advice, especially from people working as Data Engineers or those who recently switched into the field.

Thanks in advance!

reddit.com
u/shb6991 — 9 hours ago
▲ 3 r/dataengineeringjobs+3 crossposts

Looking for Data association role both remote or on-site, India

After done with my last job i learned new skill and made projects hope this will suits any available job description :)

u/CopyInteresting4394 — 12 hours ago
▲ 6 r/dataengineeringjobs+1 crossposts

Data Engineer | 4 years of data projects + 13 years in Travel/Airline domain. Looking for my next role!

Hi everyone,

I am actively looking for a Data Engineer role and wanted to put myself out there to this community.

A bit about me:

· 17 years of domain experience in the Travel, Tourism, and Airline industry (operations, revenue management, customer analytics, etc.).

· Since 2022, I have been consistently working on data-domain projects—building ETL pipelines, data cleaning, feature engineering, and analytics workflows.

· In 2024, I completed a formal Data Science course to deepen my understanding of the full data lifecycle (from ingestion to modeling).

· I actively work on Kaggle projects to sharpen my technical skills—especially around PySpark, Pandas, and SQL,ADF,Azure Cloud Platform,Databricks.

My Tech Stack:

· Languages: Python, SQL

· Big Data: PySpark, Pandas, NumPy.

· Orchestration: Apache Airflow (learning/building projects)

· Cloud: Azure

· Databases: PostgreSQL, MySQL

. Skills : Python, SQL,Pandas, ADF,Databricks,Azure Cloud Platform, Big data..

What makes me different:

I don't just know how to write code—I understand the business context behind the data.

I know how airline inventory works, what PNR data means, how pricing models fluctuate, and how customer behavior varies across segments. I've spent 17 years using this data; now I want to engineer it.

I am looking for Data Engineer roles—open to both mid-level and senior positions—ideally in Travel Tech (OTAs, GDS, Airlines, or Travel SaaS), but I'm open to other domains as well where my data skills add value.

What I'm looking for:

· A role where I can build scalable data pipelines.

· A team that values both technical skills AND domain knowledge.

· Remote / Hybrid / On-site (open to relocation for the right opportunity).

If you're hiring or know of any openings, I'd love to connect. Happy to share my resume, GitHub, or Kaggle profile.

Thanks for reading, and appreciate any leads or advice!

reddit.com
u/Comfortable-Land5207 — 14 hours ago
▲ 9 r/dataengineeringjobs+1 crossposts

Review Resume Please

Needed a Resume review, and please let me know if you have any suggestions.

PS : ignore certifications sections please, working on adding some valuable ones

u/bloatware__ — 15 hours ago

Are companies expecting full star schema diagrams in data modeling interviews now?

Has anyone else noticed that companies are asking data modeling questions like this a lot lately?

I've come across this question (or a variation of it) in multiple interviews:

>

My question is: How detailed are interviewers expecting the answer to be?

Is it enough to simply list the fact tables (Fact_Sales, Fact_Inventory, Fact_Promotion, Fact_Forecast) and dimensions (Dim_Product, Dim_Store, Dim_Date, etc.) with a short explanation?

Or are they expecting us to actually draw a complete star schema/data model during the interview, showing relationships between the fact and dimension tables? Do they also expect us to include measures/KPIs inside the fact tables (Sales Amount, Quantity Sold, Profit, Forecast Quantity, etc.) and attributes inside each dimension?

Basically, are they looking for something like:

  • Fact_Sales → Sales Amount, Quantity Sold, Discount, Profit
  • Dim_Product → Product ID, Name, Category, Brand
  • Dim_Store → Store ID, City, Province
  • Dim_Date → Date, Month, Quarter, Year

...along with a proper star schema diagram?

For those who've interviewed for Data Engineer, BI Developer, Analytics Engineer, or Data Warehouse roles recently, what level of detail did your interviewer expect?

Would really appreciate hearing your experiences.

reddit.com

Tech lead, Data engineer at Paytm

Hey folks, I’m looking for honest insights into the work culture at Paytm. I’ve got an offer (pending final approval) for a Tech Lead role, though they might internally upgrade it to Senior Tech Lead. The offer stands at 46 LPA fixed, plus a 2L signing bonus and about 7L in equity (vested over time). I’d be working in the insurance domain.
I have 6.10 years of experience working as a de/software dev

Now, I’d love to hear from people who’ve worked there or know someone who has. How is the culture—positive, toxic, or somewhere in between? What’s the reality of work-life balance there? Is job security stable, or do people feel like they’re on shaky ground? Any advice or experiences on how it really feels to be on the inside—whether positive or negative—would be super helpful! Thanks in advance!

reddit.com
u/Basic_Steak_541 — 1 day ago

Hit the 1-year mark as a Data Engineer, but I haven't written a single line of code. Feeling rusty and need advice on CS basics and life forward as an engineer.

Hey everyone,

​I’m looking for some career advice and resource recommendations because I’m feeling pretty stuck.

​I’ve been working as a Data Engineer for almost a year now, but honestly, I’m not finding it amusing or fulfilling at all. The biggest issue is the workload—or lack thereof. For the entire past year, I haven't been assigned any real work and haven't written a single line of code. I can feel my skills getting incredibly rusty, and it’s starting to freak me out.

​To make things more challenging, I don't come from a Computer Science background. In college, I only focused on Data Structures and Algorithms (DSA) to get through placements, so I’m missing a lot of the fundamental CS basics that a lot of peers take for granted (databases, operating systems, how systems actually talk to each other under the hood, etc.).

​Since I have a good amount of downtime at work right now, I want to use this time to fix my foundation, upskill, and prepare myself to look for better opportunities where I can actually build things.

​Could you guys recommend the best courses, roadmaps, or resources to get started with the core basics of Computer Science?

​Thanks in advance for the help!

reddit.com
u/Ok_Recognition_271 — 3 days ago
▲ 8 r/dataengineeringjobs+1 crossposts

Hiring Data Engineers (4+ & 8+ YOE) | Hyderabad | Referrals Available

Hi everyone!

My organization is hiring Data Engineers (4+ years) and Senior/Lead Data Engineers (8+ years) for Hyderabad. I'm happy to refer suitable candidates.

Required Skills:

  • Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
  • Databricks (PySpark, Spark, Delta Lake, MLflow)
  • Snowflake
  • Power BI (Data Modeling, DAX, Report Development)
  • Strong SQL and Python (Scala is a plus)
  • ETL/ELT pipeline development
  • Data warehousing and data modeling
  • Azure, AWS, or GCP cloud data services
  • Data governance, security, and CI/CD best practices

Experience:

  • 4+ years: Strong hands-on experience in modern data engineering and cloud data platforms.
  • 8+ years: Prior experience leading projects, designing data platforms, or working in a Lead/Architect role is preferred.

Location: Hyderabad

If you're interested or know someone who fits the profile, feel free to DM me your resume or drop it in the comments. I'll be happy to refer qualified candidates.

Thanks!

reddit.com
u/Huge-Ingenuity-5945 — 3 days ago
▲ 10 r/dataengineeringjobs+1 crossposts

Looking for Data Engineering Opportunities (2+ YOE)

Hi everyone,

I’m currently serving my notice period, and my Last Working Day (LWD) is in September.

I decided to resign because of a toxic work environment and the lack of learning opportunities in my current project. I’m now actively looking for my next opportunity as a Data Engineer.

Experience
2+ years of experience in Data Engineering

Tech Stack
Databricks
SQL
Spark SQL
PySpark
AWS
Talend
AI Copilot Development
Custom AI Agent Development

If anyone is hiring or can provide a referral for a Data Engineering role, I would really appreciate your help. Please feel free to DM me if you’d like to know more about my experience or if you have any suitable openings.

Thank you!

reddit.com
u/Any-Flamingo-3617 — 3 days ago

Looking for feedback on an end-to-end data engineering project

Hi everyone,

I've been working as a data engineer for about a year, and over the past month I wanted to push myself by building something significantly larger than the usual tutorial project.

The result is an end-to-end analytics platform built around the Wikimedia Pageviews dataset.

The original objective was simply to improve my dbt skills, but the project gradually expanded into something much larger.

One of the biggest challenges turned out not to be the scale (roughly 2 TB of public data), but the data model itself. Wikimedia publishes pageviews at the page level, while I wanted to analyze attention at the entity level. Solving that required reconciling pages across more than 300 language editions using Wikidata before building the analytical warehouse.

The project now includes:

  • BigQuery as the analytical warehouse
  • dbt for semantic modeling and testing
  • Terraform for Infrastructure as Code
  • AWS Fargate for orchestration
  • GitHub Actions CI/CD with path-based deployments
  • CloudWatch dashboards for operational monitoring and BigQuery cost attribution
  • Optional Power BI deployment through the REST API
  • Fully deployed dbt documentation
  • End-to-end reproducible infrastructure

Everything is documented, including the modeling decisions, infrastructure architecture, dashboard methodology, and deployment process.

Repository: Github Link

Live dashboard: Dashboard Link

dbt documentation: Dbt docs link

I'm posting here because I'd genuinely appreciate feedback from other data engineers.

If this project landed in front of you during a hiring process:

  • What would stand out positively?
  • What would you improve?
  • Are there parts that feel over-engineered or under-engineered?
  • Is there anything missing that you'd expect from an end-to-end data engineering project?

I'm especially interested in feedback on the architecture, modeling choices, CI/CD pipeline, documentation, and overall project structure.

Thanks in advance!

u/Business-Journalist7 — 4 days ago

Portals for job hunt

I feel naukri and linkedin are no more in the market where good product companies are looking out for candidates.
Are there any new portals or job hunt places ?

reddit.com
u/Bubbududdu2807 — 3 days ago

Referral for Data Engineer (5–7 Years Experience) – Snowflake, AWS, PySpark

Hi everyone,
My company is currently hiring Data Engineers with 5–7 years of experience (India only)

Required skills:
Snowflake
AWS (Glue, Lambda, EMR)
Python
PySpark
SQL

If your profile matches these requirements and you’re actively looking for a new opportunity, feel free to DM me. I’ll be happy to share more details and refer eligible candidates.
Please include a brief summary of your experience or your resume when you message me to help speed up the process.

Good luck with your job search!

reddit.com
u/Don_Vetto — 4 days ago

Referral for Senior Azure Data Engineer (6–10 Years Experience | India)

Hi everyone,
My company is currently hiring Senior Azure Data Engineers with 6–10 years of experience.

Required skills:
Azure Data Factory
Azure Databricks
Snowflake
DBT
SQL
ETL
Python
Azure DevOps

If your experience matches these requirements and you’re interested in exploring a new opportunity, feel free to DM me. I’ll be happy to share more details and refer eligible candidates.

Please include your resume and a brief summary of your experience when reaching out.

Good luck with your job search!

reddit.com
u/Don_Vetto — 4 days ago

Job Market for a Data Engineer on an H1 visa

I am a Data Engineer with an overall experience of 3 years but Data Engineering exp of 1.5 years. This is the stack I work with: GCP (BigQuery, Cloud Storage, PubSub, Cloud functions, Composer), SSMS, Autosys. I can fluently use Python and SQL at this point. I also work with the other deployment tools like Harness, Jenkins and UCD

I do have some visualization exp in PowerBI and Tableau but not extensive.

I work in a service industry where the client I work with is a bank. I've been meaning to switch for a while now. I have been trying for a month and a half. Absolutely no call backs. I have been thinking it's probably because my resume is quite generic and the market is probably saturated with these skills already. What do I do to set myself apart? What are the skills that would bring my profile some attention. Any general inputs about market or work search strategy help is also appreciated.

I am on an H1visa btw.

reddit.com
u/Jumpy_Ad_4110 — 5 days ago