Hi,

this may be interesting for people who are experiencing slow execution times of their migration and maybe it could be worth including it in the documentation.

During the last few days I've worked on migrating about 200k users from a Drupal 6 DB (using the MyISAM storage engine) to a Drupal 7 DB (InnoDB). I've set up a 'large' Amazon Web Service instance and configured it especially for this migration (yes, I took care to meet the needs of both MyISAM and InnoDB). Although I've spend several hours on tweaking the environment variables, I wasn't able to increase the throughput beyond an average of 100 users per minute. Even this value had to be bought with setting 'innodb_flush_log_at_trx_commit' to '0'. But once I set the storage engine of all D7 tables from InnoDB to MyISAM, the throughput was increased to about 1000 users/minute. I've set the storage engine of the D7 DB back to InnoDB after the migration and the site's working fine.

Comments

mikeryan’s picture

Title: Regarding the slow execution time of migrations » Documenting optimizing MySQL for performance
Project: Drupal-to-Drupal data migration » Migrate
Version: 7.x-2.0 » 7.x-2.x-dev
Category: support » task

Not specific to Drupal-to-Drupal migrations. I have some sample MySQL configuration options of my own, we should add a page to the d.o docs.

mikeryan’s picture

Assigned: Unassigned » mikeryan
Status: Active » Needs review

I've finally put together a page on database performance at http://drupal.org/node/1994584 (incorporating some hardware notes from #1978374: Migration Speed). I'm no DBA, so any further suggestions are welcome.

Thanks.

mikeryan’s picture

Status: Needs review » Fixed

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

Anonymous’s picture

Issue summary: View changes

typo