When running a fairly large (50,000+) migration (field_collections w/ stubs) via the Migrate UI, I get the following error about every ~10,000 imported:

An AJAX HTTP error occurred.
HTTP Result Code: 200 Debugging information follows.
Path: /batch?id=24&op=do StatusText: OK
ResponseText: Uncaught exception thrown in shutdown function.
PDOException: SQLSTATE[HY000]: General error in MigrationBase->endProcess() (line 967 of sites/all/modules/contrib/migrate/includes/base.inc).

There are no additional errors in the watchdog and when returning to the migrate page, the migration is stuck in "Importing", which I have to reset to continue. Any ideas for continuing to use the Migrate UI for this?

Comments

firewaller created an issue.

firewaller’s picture

firewaller commented

I managed to fix it by increasing the execution times and timeouts temporarily in settings.php (I don't know which of the 3 did the trick):

// Extend local memory.
ini_set('max_execution_time', 0);
ini_set('default_socket_timeout', 0);
$conf['http_request_timeout'] = 0;

firewaller’s picture

firewaller commented

However, this made me realize that the progress bar is not increasing (always stays at "Starting import process" unless finished or error thrown). I've seen it work earlier, but not for quite some time. Any ideas?

stevesirois@gmail.com’s picture

stevesirois@gmail.com commented

You should not run long running import from the UI but instead use drush. Check https://www.drupal.org/node/1958170