Trying to understand how this is used. Since it tells me to delete the site's robots.txt file, I assumed it would create a new one. I have a multi site (two domains), and a number of subdomains for each (www., qa. , dev.). The subdomains would use the same values. How do I create different robots.txt for the two domains? Is there a user's guide I might have missed?

Sorry to seem so clueless, but didn't see anything in the readme or code. Looks like a great module, thanks.

Comments

pglatz created an issue. See original summary.

pglatz’s picture

pglatz commented
Issue summary: View changes
hass’s picture

hass commented
Status: Active » Fixed

No. Suggest testing the module first.

pglatz’s picture

pglatz commented

I did test the module and see it stores the information in the database. I don't know what to do with it; do I cut and paste it to a robots.txt file? My impression was this module would allow creating different versions of the file for different subhosts, which would be very useful.

bryancs’s picture

bryancs commented

Short answer: I think NO.

I am running a multi-site Drupal 8 installation and uses this module.
Each site uses different robots.txt but all sub-domains under a site uses the same robots.txt.
If you follow the installation instruction here, you should be able to add individual robots.txt values to each site when you go to admin/config/search/robotstxt
Also, you can set default robots.txt per site by adding a default.robots.txt file under web/sites/siteA.com and/or web/sites/siteB.com.
Test it by accessing siteA.com/robots.txt or siteB.com/robots.txt

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.