Can you support robotstxt?

CommentFileSizeAuthor
patch-to-support-robotstxt.diff1.34 KBCKIDOW
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

CKIDOW created an issue. See original summary.

skullhole’s picture

skullhole CreditAttribution: skullhole as a volunteer commented
Assigned: Unassigned » skullhole

Thanks, CKIDOW.
Will apply it asap.

monstrfolk’s picture

monstrfolk CreditAttribution: monstrfolk commented

Can there be an option to exclude the sitemaps from robots.txt?

skullhole’s picture

skullhole CreditAttribution: skullhole as a volunteer commented

CKIDOW,

I looked into the request - I believe that support should be added in xmlsitemap module itself.
It is designed to be able to contain multiple sitemaps thus it is not a problem to have it.

skullhole’s picture

skullhole CreditAttribution: skullhole as a volunteer commented
Status: Active » Closed (won't fix)

CKIDOW,

closing the issue in favour of Improve robotstxt support