Advice for DE,DA and DS architecture that is the best
Hello to all,
I have curently changed my team and they only have MsSql as storage solution and PBI as reporting solution.
I want to create a proper architecture,that will cover ingestion,etl ,storage ,reporting and later on data science stuff (with keeping previous two stuff for storage and reporting)...
I do not know what softwares are the best for the job ,and some of the options that I know might pass in our company are as follows:
-MS Fabric
-Knime analytics(i have used this before) heavily
-Databricks ( one i am most interested in)
I am talking here about only ETL part that I can set automatic schedules....
I am still a junior so, I am in need of some advice which is the best ...or maybe even get some other advice that would help me!
Thanks upfront