Using MigrateSourceJSON as source class to import a huge chunk of data from an API we noticed that every time migrate_ui_batch(); reloads the Migration::getInstance($machine_name); to get the next layer of records to import, it was losing the source pointer called $active_url (plugins/sources/json.inc), this way the migrate was looking into all the sources again from the beginning. In order to avoid this situation we decided to storage this pointer inside a variable_get();, it might not be the best approach but solves it.

CommentFileSizeAuthor
#2 active-url-json-2701095-1.patch1.72 KBgabrielmachadosantos
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

gabrielmachadosantos created an issue. See original summary.

gabrielmachadosantos’s picture

gabrielmachadosantos CreditAttribution: gabrielmachadosantos at CI&T for Pfizer, Inc. commented
FileSize
active-url-json-2701095-1.patch1.72 KB
pifagor’s picture

pifagor
Location 🇺🇦 Rivne
CreditAttribution: pifagor at Drupal Ukraine Community, GOLEMS GABB for GOLEMS GABB, Drupal Ukraine Community commented
Status: Needs review » Reviewed & tested by the community

pifagor’s picture

pifagor
Location 🇺🇦 Rivne
CreditAttribution: pifagor at Drupal Ukraine Community, GOLEMS GABB for GOLEMS GABB, Drupal Ukraine Community commented
Status: Reviewed & tested by the community » Fixed

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

joseph.olstad’s picture

joseph.olstad
Primary language French
CreditAttribution: joseph.olstad commented

https://www.drupal.org/project/migrate/releases/7.x-2.12