Early Bird Registration for DrupalCon Portland 2024 is open! Register by 23:59 PST on 31 March 2024, to get $100 off your ticket.
When crawling a feed using a URL pattern, Feeds Crawler correctly ends when the last index 404's, however the Feeds module reports a 404 error when attempting to access this URL. Here's a patch to check the validity of the iterated URL pattern, and if the page is not found, quit crawling the feed.
Comment | File | Size | Author |
---|---|---|---|
#1 | feeds_crawler-404fix-2189555-1.patch | 906 bytes | bjpritch |
Comments
Comment #1
bjpritch CreditAttribution: bjpritch commentedComment #2
Jony_Niuqiang CreditAttribution: Jony_Niuqiang commentedHow to use it?
Comment #3
Nikolay ShapovalovI think make request to server, just to check page status is bad idea.