feeds 8.x-3.0-beta5

Skippable entity validation; prevent indefinitely growing filesystem

Entity validation can now be skipped

On the feed type you can now configure to skip entity validation during an import. This can for example be useful if you have a required field on an entity type, but you want to ignore that during a feed import. You can choose to skip all validations or only validations of a certain type. To ignore required fields, select the validation type "NotNull".

Indefinitely growing filesystem on a failed http fetch

When fetching a http resource fails with a 404, Feeds retries to fetch the resource on every cron run. There was a bug that caused the filesystem to grow during this process. That bug is now fixed. However, the issue that Feeds retries to fetch the same resource over and over again remains.
Ideally, Feeds would retry 10 times at max and then abort the import process. That looks complicated to implement: it is either aborting immediately after the first attempt or forever keep retrying. I attempted to implement the limited number of retries in #3277999: Add DelayedRequeueException feature to feeds queue - D9.1, but I ran into other issues while doing so.

Next release: Drupal 11 support will be added, Drupal 9 support will be dropped

This is the last Drupal 9 compatible Feeds release. Next release will focus on making Feeds compatible with Drupal 11 and support for Drupal 9 will be dropped in that process.

Contributors (53)

MegaChriz, mauriciopieper, bburg, Steven Jones, Aron Novak, ankitv18, ptmkenny, jcnventura, dharnell.a007, hugronaphor, franz, sidharth_soman, Greg Boggs, chaitanyadessai, _shY, ryanrobinson_wlu, abhishek_gupta1, murrow, carolpettirossi, pfrilling, hmendes, caspervoogt, chriswinger, jsutta, sarwan_verma, jnicola, HeikkiY, maskedjellybean, devad, Hydra, interlated, Shreya_th, AlvaroDeMendoza, agn507, p4trizio, bmcclure, LeDucDuBleuet, Andriy Khomych, kimberleycgm, narendragupta, hideaway, j.lucky, NWOM, artem_kondra, alt.dev, irinaz, ransomweaver, jrb, Xperd, mandus.cz, nicole.harnish, jrochate, david.qdoscc

Changelog

Issues: 27 issues resolved.

Changes since 8.x-3.0-beta4:

Bug

• #3158678 by MegaChriz, bburg, Steven Jones, Aron Novak: Catch FileException and abort import on cron runs when file to import is missing.
• #3441669 by MegaChriz, ptmkenny: Fixed referencing by role ID is missing on the mapping page.
• #3080098 by MegaChriz, jcnventura, dharnell.a007, hugronaphor: Fixed delete http fetched file in case of a 304 or if the document is empty.
• #3372368 by MegaChriz, Aron Novak: Fixed in_progress filesystem grows indefinitely when a http fetch fails with a 404.
• #3412146 by MegaChriz, sidharth_soman, Greg Boggs: Fixed missing log file results into a fatal error in the log UI.
• #3031019 by MegaChriz, carolpettirossi, pfrilling, hmendes, caspervoogt, chriswinger, jsutta: Fixed undefined index: allowed_extensions AJAX error when creating feed types.
• #3390530 by MegaChriz, sarwan_verma, jnicola, HeikkiY, maskedjellybean: Fixed Call to a member function unlink() on null in Drupal\feeds\Result\HttpFetcherResult->cleanUp().
• #3405607 by MegaChriz, devad: Added laminas/laminas-feed as an installation requirement + provided brief instruction about how to obtain the library.
• #3398550 by MegaChriz, interlated, Shreya_th, AlvaroDeMendoza: Fixed "Cannot use object of type Feed as array" error when trying to clone a feed.
• #3185907 by MegaChriz, ransomweaver, jrb, Xperd, mandus.cz: Prevent PHP fatal error during Clean stage when using an action plugin with a long name.
• #3372534 by MegaChriz, nicole.harnish: Fixed request_timeout setting from HttpFetcher not used.
• #3365653 by david.qdoscc: Check if actions already exist in feeds post updates.

Tiny bugs

• #3449702 by mauriciopieper, MegaChriz: Added different log message when the option to not insert new result entities is selected.
• #3423513 by _shY, ryanrobinson_wlu: Fixed a few PHPUnit warnings about return types and NULL values.
• #3406779 by Hydra: FeedsFileSystemBase::saveData() should return the path the file was saved to.
• #3419930 by abhishek_gupta1, murrow: Corrected reference to FeedsFileSystemInterface in docblocks of HttpFetcher class.

Feature

• #3401002 by MegaChriz, agn507: Added easier way to override HttpFetcher::get() for passing extra request options.
• #3207793 by p4trizio, bmcclure, LeDucDuBleuet: Allow to reference existing entities by email.
• #3062232 by Andriy Khomych, MegaChriz, kimberleycgm, narendragupta, hideaway, j.lucky, NWOM, artem_kondra, alt.dev, irinaz: Added feature to disable entity validation.
• #3097522 by jrochate: Set maximum length of blank source's value to 1024 to decrease length limitation of Feeds Extensible Parser's custom source types.

Task

• #3450827 by ankitv18: Fixed unit tests for the next minor of Drupal Core.
• #3425219 by franz, MegaChriz, ptmkenny: Fixed eslint and styleint issues.
• #3442558 by ptmkenny: Removed unused method BlankSource::supportsParserType().
• #3426951 by chaitanyadessai, MegaChriz: Fixed a few \Drupal calls in classes by using dependency injection instead.
• #2939688 by MegaChriz: Fixed remaining phpcs issues.
• #3424932 by MegaChriz: Made tests pass on GitLab CI.
• #3437473 by ankitv18: Fixed a few deprecations in Kernel tests.