I'm not quite sure if this is a local development environment (MAMP) issue or an issue with the module, but basically the module retrieves the page for crawling successfully (in $result in feeds_imagegrabber_webpage_scraper), but then for some reason also retrieves a 403 error from the header and just stops. When I remove all code telling it to stop when getting a 403, the crawl is successful. Both the site and the rss feed it is trying to import are localhost.

Any hints would be appreciated. Also thought I'd throw this out there in case anyone else has this usse.

Comments

Melissamcewen’s picture

Status: Active » Closed (works as designed)

Turns out it was a localhost configuration issue. So closing.