u/Comfortable-Bar-9983

Hi All

I am working as a DE with 4.5 YOE in Azure tech stack. I need some help on the ELT processes in Snowflake, preferably from someone who is already working with Snowflake for complete ETL setup.

We can connect over teams/meet for approx 1 hour call today evening or night, tomorrow or Wednesday early morning.

Any help is appreciated.

Thanks & Best Regards

I m planning to go scuba diving this year (date not finalized yet).

I have some questions regarding the same :

1. What are the best spots for scuba diving in India?

2. How much time do they take to teach and how much will they charge? (Will help me estimate the travel plan)

3. Do we need to acquire any licenses as well?

Any leads and pointers are appreciated. Thanks for your help.

P.S : 27 M from Ghaziabad

Hi All, Greetings for the Day!!

I am working as an Azure data engineer and need some help. My main work revolves around batch data and dealing with structured and semi structured data.

Recently, in one of the interviews, I was asked that how will I design a data pipeline for unstructured data (images, pdfs, videos, etc), which I was unable to answer and hence got rejected. Now, I know that we can parse images in form of pixels and 2d arrays, similarly, pdfs can be parsed using pydf library. I haven't practically worked on them, so I want to understand how we can process them in a medallion architecture setup. How we can store them, collect them, etc.

I am looking for guidance and will really appreciate it if someone can show me even one example for the same.

Thanks & Best Regards

Edit : Thanks for the replies guys. My problem statement was to prepare unstructured data for data scientists team to use further (model training for example) and store it in medallion architecture setup. Archival is included as well.