The multilink_redirect module prevents crawlers from indexing all available languages.

Example:
We are using an external crawler for site indexing and site search. This crawler should index the given site in all available languages. But as expected, the multilink_redirect module performs a redirect on every page, which is requested in a language, not configured as default (because the crawler works stateless).

Solution:
As a simple solution I have extended the ignore capabilities of multilink_redirect by two additional textareas for IPs and User-Agent strings to ignore.

CommentFileSizeAuthor
#2 multilink_redirect-extend-ignore-capabilities-2-D7.patch2.88 KBlabonte
multilink_redirect-extend-ignore-capabilities-1-D7.patch2.8 KBlabonte
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

labonte created an issue. See original summary.

labonte’s picture

labonte CreditAttribution: labonte commented
FileSize
multilink_redirect-extend-ignore-capabilities-2-D7.patch2.88 KB

Here is a minor improvement of the previous patch, considering the case, when a proxy is involved. The code now first checks for a HTTP_X_FORWARDED_FOR header to use, before falling back to the webservers REMOTE_ADDR.