Thanks for the great and easy-to-use module.

I found out recently that some scraper go through the sitemap xml files of my site which is full of science data and they scraped it since the sitemap give URLs to all content. I want to submit my content to Google and Bing, but at the same time I would like to prevent public access to my sitemap file. A way of doing it is by renaming the file or maybe the URL path. I tried to change the URL under settings, but it doesn't work although it accepts the changed URL. When I go to the new custom URL, nothing shows up,but when I go to www.mysite.com/sitemap.xml, I can see it.

I hope you really consider adding such feature or any way of protecting XML sitemap files from scrapers.

Thanks in advance for your support.

Comments

Snehal Brahmbhatt’s picture

Read this article.

Hope this helps you.

Thanks,
Snehal Brahmbhatt | AddWeb Solution
https://www.drupal.org/user/3147795/track

memoday’s picture

Thanks Snehal for your reply and the article. I appreciate it. I still hope there is a way to at least rename the sitemap file or change its URL/Path.

Snehal Brahmbhatt’s picture

My pleasure! Let me know if you have any further concern/issues.

Ready to help :)