Hi there,
I'm working with a csv file as source; but the field that is used as sourceid sometimes have a duplicate record; so it doesn't import again. That's ok; but my problem is because if it gives me unprocessed rows. Since I have other migrations depending on the first one; they don't get executed due to these unprocessed rows.

Example:
- I have a file with ten rows; but 2 of them are duplicated (I can't verify this file before because client is the person who is going to upload that file through a custom UI).
- When that file gets imported it says that 1 row is unprocessed.
- Any dependent migration doesn't get executed due to the unprocessed row.

Any idea how could I fix this?

Comments

mikeryan’s picture

mikeryan
he/him
Primary language English
Location Pittsfield, MA, USA
commented
Priority: Critical » Normal
Status: Active » Fixed

Of course, the ideal thing to do is to fix the source data, but you knew that...

Use the --force option on the drush mi command to skip checking of dependencies. Or, if running migrations in the UI, check the "Ignore dependencies" checkbox under Options.

kporras07’s picture

kporras07 commented

Thanks @mikeryan.
I finally created a source plugin extending from the migrate csv source class and implemented the computeCount function for avoiding the dupe rows to be counted.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.