r/DataEngineeringPH

Hey everyone! I recently joined a trading firm as a backend-heavy full-stack dev (Java/Spring). I’ve been really enjoying the work, but a recent reorg just moved me to a completely different team.

To give you an idea of the shift:

• Old Team: Java, Kafka, and Flink. We processed thousands of daily trades from raw to normalized data using a Medallion architecture.
• New Team: Python, Spark, AWS Lambda, and Glue. Strictly ETL work.

I’m completely new to this second stack but eager to learn. This transition made me wonder: have I essentially been doing Data Engineering this whole time without the title? If so, how can a traditional backend dev quickly ramp up on Data Engineering? I'm currently diving into Python, AWS, and core ETL concepts, but I would love any advice or resources!