u/kec15

Hi guys, Data Engineer using Microsoft Fabric here.

I have a pretty specific issue that I believe I know what is causing it.

So we have a Medallion Architecture setup and a Pipeline that runs from Bronze -> Silver -> Gold. All of the data runs with stored procedures sequentially and we use Lakehouse and Warehouse shortcuts, so after a Lakehouse/Warehouse is updated via the stored proc then it is used in another layer via shortcut.

I have noticed that the Metadata Sync sometimes gets delayed by 10-20 minutes, which is pretty long as the way our pipeline works it needs to be done pretty much in 5 minutes max.

Is there a way to trigger this Metadata Sync in any way. I tried doing it with a Notebook API call and it didn't work.

Thanks in advance!