Problem/Motivation
* I have around 20 migrations that import blocks, nodes, paragraphs, and taxonomy terms.
* When I run the migrations on Acquia, the disk space usage goes up due to the number of write-queries that are executed by "drush mim --sync". Removing the --sync option fixes this though, i.e. way lesser queries.
* Most of these queries are for the key_value table (state).
* Additionally, when I run all the migrations one by one with --sync, they run faster than if I run them all with --all --sync.
drush mim {migration.id} --sync: 3m8.960s
drush --all --sync: 8m31.586s
These figures are for running all migrations with no changes, i.e. no create, update, or rollbacks caused by the execution of both the commands.
Steps to reproduce
* Run "drush mim --all --sync" and observe the number of UPDATE, DELETE, and INSERT queries that are executed.
** You can do so with "SET global log_output = 'table'; SET global general_log = on;" and then watching the "mysql.general_log" table.
* Run "drush mim {migration.id} --sync" on all migrations one by one and see that it finishes faster than when using "--all"
Comments
Comment #2
pacproduct commentedHi!
For info, I'm pretty sure the issue described here is the exact same one I faced. But because I use
migrate_toolsversion 6 for Drupal 10, I created a dedicated issue. See https://www.drupal.org/project/migrate_tools/issues/3378047Comment #3
jigariusThanks for the info. I'm closing this as a duplicate.