I'm upgrading a large site and am finding the performance of drush content-migrate-data to be incredibly slow. At this rate, it will take me a month to migrate all my field data...

Tracked the problem down to _content_migrate_batch_process_migrate_data running a batch of only one item at a time. Attached patch lifts it up to 1000 at a time and speeds the process greatly.

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

Jody Lynn’s picture

Woops, had some other stuff in the last patch

Jody Lynn’s picture

FileSize
4.94 KB

Better patch.

Jody Lynn’s picture

FileSize
4.26 KB

Here's a new patch. The last one was broken.

Jody Lynn’s picture

I'm using this for another large site now, and can confirm it makes the field migration via drush about 100x faster (20 minutes instead of 3 days)

webchick’s picture

This sounds important.

Senpai’s picture

Status: Needs review » Needs work

Patch appears to be malformed. It does not apply to / or sites/all/modules/

Senpai’s picture

Status: Needs work » Needs review

Ahh HAH. Patch applies successfully if you manage to navigate your way into /sites/all/modules/cck/modules/ and apply it there. Do not rely on the header paths of the patch file.

Senpai’s picture

Testing now...

Senpai’s picture

Status: Needs review » Reviewed & tested by the community

Superb! The patch in #3 shaved a metric ton off the drush execution time of a D5-to-D7 site conversion! Before the patch == 2.2 hours for the first 5 fields. After the patch == 12 minutes for all the fields!

I give this one two thumbs up.

13rac1’s picture

+1 for #3 and #9. So much faster!

yched’s picture

Status: Reviewed & tested by the community » Fixed

Committed. Thanks !

Automatically closed -- issue fixed for 2 weeks with no activity.

C-Logemann’s picture

Issue summary: View changes

I am working on an additional performance improvement of the database query for node searching. When I was writing my new drush option "--range" I also added an option "--chunk" for the batch improvement of this issue. Here is the link to my issue with patch if somebody is interested: #2388463: Limit db node search to increase performance on huge content_migrate imports (incl. drush options)