Updating approx. 200k contact records
Hi guys.
Our company has a new requirement whereby we must update approx. 200,000 contact records every night with updated data from another system. Each contact will have two custom fields updated each night.
We already have several jobs running that perform updates to records in custom entities at a similar volume. However, I know from previous data migration activities that contact records seem to take much longer than updates to custom entities for one reason or another.
The other jobs that we have (C# exe's) use the CRM SDK in conjunction with threading and ExecuteMultiple requests to perform the updates in batch.
I am just looking for opinions as to what people think the optimal approach would be nowadays to perform that volume of contact record updates in the shortest amount of time possible? I will be bypassing plugin execution where possible (there is an option for this when using the CRM SDK in C#).
Perhaps there are more optimal modern apaproaxches available nowadays that we should be using instead?
I saw a recommendation elsewhere around using the WebApi to perform batch updates but I'm not seeing much in the way of examples out there.
Any advice much appreciated.
Thank you