Today we were looking at Google Webmaster and we noticed more than 2000 crawl errores. When looked into the issue we noticed that there are links with domain name added after the broken links example:

http://www.muktware.com/n/10/2011/765/Muktware.com

We also don't see any reason for creating links like this:

http://www.muktware.com/n/10/2011/

1. Can someone help why Drupal is adding domain name at the end of broken links?
2. How to fix this problem so that Google doesn't crawl broken links?
3. Does this crawl error effect page rank and we notice that many smaller and spammy sites are ranked above us.

Core:
Drupal 7 (fully updated)
URL Modules installed:
Path Auto
Global Redirect

Arnie

Comments

phani00’s picture

1. looks as if this is the action of a module, mis-configured pathauto per example. don't remember what other modules are there that can influence this, something with "permalink" in the name IIRC.

to solve this, one needs to know more: drupal version, and modules used that can change the path.

2. to stop google analytics from trying to use those links, you'll have to disallow them in your robots.txt file.

3. not sure how badly it affects page rank; not an SEO expect.

phani00’s picture

actually, where does google get these links from? are they assigned to the nodes in question (even though they don't work)?

if not, it might not be pathauto, but some google related module that tries to provide these links, google sitemaps, adsense, or the like. which of those are you using? (and none of which i've ever used.)

phani00’s picture

i'd also disable global redirect until this is solved. don't see how or why the global red. module would do anything like that, but better to keep things simple until you know what's going on.

i think you should be able to find out from google's webmaster tools where it gets these URLs from. unless you know that, i don't know how to approach this. it's definitely not drupal core doing it, so the issue is probably misplaced.

arnieswap’s picture

Project: Core development » Global Redirect
Version: » 7.x-1.4
phani00’s picture

does that mean disabling global red. module solves your problem?

arnieswap’s picture

No.

arnieswap’s picture

Issue summary: View changes

Added info about installed version.