r/bigquery

Hello everyone,

I’m new into the data engineering world and as the title says, I’m thinking of using BigQuery to build a data warehouse. Currently my company don’t have one, so I’m looking for good price/performance options. We mostly use APIs and a few excel files as data sources

I have considered Azure SQL, Supabase and others but this one seems to be the best for data analysis and BI

What would be your recommendation?

hi beautiful people

I'm having a connection issue where my query is intended to use the production project
prj-gcp-bq-sharing-prd-rti
 
but, when the query executes, the error message shows that it is trying to access a table in the development project instead:
prj-gcp-bq-sharing-dev-rti:P_GENERAL_VIEWS.F_SUBSCRIBER_EVENTS
 
error:

 
I've tried with and without the preview feature, none is working. ODBC connector works fine tho.
Any ideas?

Anybody has any recommendation for platform, I could use to import data from third party applications, like mailchimp/klaviyo/rakuten etc.

In the past we used Skyvia, but as some of the platforms have 10s of millions of records the cost were getting out of control. Now i pretty much code it each time by hand, but frankly, that work doesn't spark a joy.

I am looking for solution that ideally charges per resources used or just has flat fees, but ideally is just point and click as i would like marketing team to take care of that.