Problem/Motivation

* I have around 20 migrations that import blocks, nodes, paragraphs, and taxonomy terms.
* When I run the migrations on Acquia, the disk space usage goes up due to the number of write-queries that are executed by "drush mim --sync". Removing the --sync option fixes this though, i.e. way lesser queries.
* Most of these queries are for the key_value table (state).
* Additionally, when I run all the migrations one by one with --sync, they run faster than if I run them all with --all --sync.

drush mim {migration.id} --sync: 3m8.960s
drush --all --sync: 8m31.586s

These figures are for running all migrations with no changes, i.e. no create, update, or rollbacks caused by the execution of both the commands.

Steps to reproduce

* Run "drush mim --all --sync" and observe the number of UPDATE, DELETE, and INSERT queries that are executed.
** You can do so with "SET global log_output = 'table'; SET global general_log = on;" and then watching the "mysql.general_log" table.
* Run "drush mim {migration.id} --sync" on all migrations one by one and see that it finishes faster than when using "--all"

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes

Comments

jigarius created an issue. See original summary.

pacproduct’s picture

Hi!
For info, I'm pretty sure the issue described here is the exact same one I faced. But because I use migrate_tools version 6 for Drupal 10, I created a dedicated issue. See https://www.drupal.org/project/migrate_tools/issues/3378047

jigarius’s picture

Status: Active » Closed (duplicate)

Thanks for the info. I'm closing this as a duplicate.