Add the --limit option to the drush migrate-import command, to import a sampling of the specified migration(s) based on item count (--limit="200 items") or time (--limit="300 seconds").

CommentFileSizeAuthor
#4 implement_limit-2432983-4.patch2.24 KBmikeryan

Comments

mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Parent issue: #2432981: Implement --update option on migrate-import » #2403393: [meta] Implement full-featured drush commands for D8 migrate
mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Status: Active » Postponed
Related issues: +#2309695: Add query batching to SqlBase

Depends on #2309695: Add query batching to SqlBase.

mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Related issues: -#2309695: Add query batching to SqlBase

Actually, we'll be doing this with events, but there's a bit missing in terms of conveying the signal to stop - it was originally going to go into #2541580: Remove obsoleted functionality from core Migrate, but it was decided that should be a different issue. So, we're waiting on a core piece to enable us to get out of the import loop when the limit is reached.

mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Related issues: +#2545672: Handle various migration interruption scenarios
StatusFileSize
new implement_limit-2432983-4.patch2.24 KB

Here's a patch that works with #2545672: Handle various migration interruption scenarios.

  • mikeryan committed fb63fed on 8.x-1.x 
    Issue #2432983 by mikeryan: Implement --limit on migrate-import
mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Version: » 8.x-1.x-dev
Status: Postponed » Fixed

Done!

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.