In 2.x simple_sitemap hooks to robotstxt and adds a Sitemap: ... entry into the dynamically generated robots.txt file.

As 3.x has a much more abstract approach to sitemap generation, the module should not assume that the default sitemap is to be included in robots.txt, as any sitemap variant may or may not be used for the purpose of content indexation through search engines.

Therefore it should be up to the site builder to use the robotstxt hook and simple_sitemap's API to include any sitemap variants into robots.txt.

Comments

gbyte.co created an issue. See original summary.

  • gbyte.co committed d736de1 on 8.x-3.x 
    Issue #3002208 by gbyte.co: Remove robotstxt module support
gbyte’s picture

gbyte
Location Berlin
commented
Status: Active » Fixed

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.

promo-il’s picture

promo-il commented

No need to impose what and how. As much, he chooses what is needed. And it is necessary to implement this option in the settings.