August 20, 2012 3 Comments
For those of you who have done data migration or integration with Dynamics CRM Online, you know that the performance may be a challenge. I recently faced that challenge during a recent project.
I had approximately 52,000 account records with associated contacts to import. I also needed to do a check (Seek Step) against CRM to see if the record was already in CRM. I was using Scribe Insight with my source being Excel and my target was Dynamics CRM Online using the Dynamics CRM Adapter. On my first attempt my job ran for 9 hours and only imported approx. 15,000 records. At that rate it would have taken over 30 hours to complete. That rate is not really acceptable. It also potentially adds other issues like the connection being dropped after some period of time and then I would have to restart the integration. Some of my colleagues have said they have seen the Dynamics CRM connections dropped around the 8 hour mark.
The question then becomes how to combat this issue. Continue reading and I’ll explain how I was able to increase the performance from about 30 source records per minute to an average of 200 source records per minute. I say source records because in the job that I am discussing each source record may create one or two records. Read more of this post