Support for Drupal 7 is ending on 5 January 2025—it’s time to migrate to Drupal 10! Learn about the many benefits of Drupal 10 and find migration tools in our resource center.
I'm upgrading a large site and am finding the performance of drush content-migrate-data to be incredibly slow. At this rate, it will take me a month to migrate all my field data...
Tracked the problem down to _content_migrate_batch_process_migrate_data running a batch of only one item at a time. Attached patch lifts it up to 1000 at a time and speeds the process greatly.
Comment | File | Size | Author |
---|---|---|---|
#3 | 1262808.patch | 4.26 KB | Jody Lynn |
#2 | cck-1262808.patch | 4.94 KB | Jody Lynn |
#1 | content-migrate-performance.patch | 6.58 KB | Jody Lynn |
content-migrate-performance.patch | 8 KB | Jody Lynn |
Comments
Comment #1
Jody LynnWoops, had some other stuff in the last patch
Comment #2
Jody LynnBetter patch.
Comment #3
Jody LynnHere's a new patch. The last one was broken.
Comment #4
Jody LynnI'm using this for another large site now, and can confirm it makes the field migration via drush about 100x faster (20 minutes instead of 3 days)
Comment #5
webchickThis sounds important.
Comment #6
Senpai CreditAttribution: Senpai commentedPatch appears to be malformed. It does not apply to / or sites/all/modules/
Comment #7
Senpai CreditAttribution: Senpai commentedAhh HAH. Patch applies successfully if you manage to navigate your way into /sites/all/modules/cck/modules/ and apply it there. Do not rely on the header paths of the patch file.
Comment #8
Senpai CreditAttribution: Senpai commentedTesting now...
Comment #9
Senpai CreditAttribution: Senpai commentedSuperb! The patch in #3 shaved a metric ton off the drush execution time of a D5-to-D7 site conversion! Before the patch == 2.2 hours for the first 5 fields. After the patch == 12 minutes for all the fields!
I give this one two thumbs up.
Comment #10
13rac1 CreditAttribution: 13rac1 commented+1 for #3 and #9. So much faster!
Comment #11
yched CreditAttribution: yched commentedCommitted. Thanks !
Comment #13
C-LogemannI am working on an additional performance improvement of the database query for node searching. When I was writing my new drush option "--range" I also added an option "--chunk" for the batch improvement of this issue. Here is the link to my issue with patch if somebody is interested: #2388463: Limit db node search to increase performance on huge content_migrate imports (incl. drush options)