Bots does not see the redirection for not translated pages [#2510432]

I am using this module for dealing with bots (Google & Bing) errors for not translated pages. For example if www.domain.com/en/xxx does not exist it is supposed to be redirect to www.domain.com/xxx. For an anonymous human it works well. But Webmaster Tools continues to say that www.domain.com/en/xxx does not exists falling into a 404 page error. And when i try to obtain the page seen by Bing Webmaster Toools I get a 404 error page with a link to www.domain.com/en/en/xxx

I am using en and pt languages, with pt as default but without prefix. I am also using Global Redirect with Language Path Checking active.

Comments

Comment #1

carlos.macao CreditAttribution: carlos.macao commented 23 June 2015 at 06:25

Issue summary:

View changes

Comment #2

Andy Inman CreditAttribution: Andy Inman commented 24 June 2015 at 10:54

Can you give me an example URL on your site?
My guess is that the bot is not providing a preferred language in the HTTP request, and that is affecting the result.

Do you have curl (Linux command-line utility)? If you do, try testing the site with curl -I [your URL] -

Here's example output from curl for a redirect:

# curl -I www.netgenius.co.uk

HTTP/1.1 301 Moved Permanently
Server: nginx/1.4.6 (Ubuntu)
Date: Wed, 24 Jun 2015 10:52:58 GMT
Content-Type: text/html
Content-Length: 193
Connection: keep-alive
Location: http://netgenius.co.uk/

Comment #3

carlos.macao CreditAttribution: carlos.macao commented 24 June 2015 at 15:01

Hi, thank you for the clue.

Google Webmaster Tools complains about hreflang so I installed https://www.drupal.org/project/hreflang and I will wait for a few days.

I've executed curl on server for www.domain.com/en/xxx and I don't see the redirection, it gives me a 404 error. But when I try to navigate on local browser I get the "pt" redirected page: www.domain.com/xxx.

I will send you an url privately.

Comment #4

carlos.macao CreditAttribution: carlos.macao commented 30 June 2015 at 10:11

Well, now Webmaster Tools sees the metatag hreflang:

<link href="http://domain.com/?multilink=switch" rel="alternate" hreflang="pt-pt" />
<link href="http://domain.com/en?multilink=switch" rel="alternate" hreflang="en" />

But the result is the same.