By bserem on
Change record status:
Published (View all published change records)
Project:
Introduced in branch:
11.4.x
Introduced in version:
11.4.0
Issue links:
Description:
The default robots.txt file now includes rules to prevent search engine crawlers from indexing search result pages that use query parameters. Both path-based and query parameter search URLs are blocked.
This prevents search engines from crawling URLs like /search?q=keyword, /search?f[0]=type:article, or any search result page that uses query strings.
Only sites with a customized robots.txt file should update the file to include these changes.
Examples for sites with a custom robots.txt
Manually add these two lines to your robots.txt file:
Monolingual sites
Disallow: /search? Disallow: /index.php/search?
Multilingual sites
Disallow: /*/search/ Disallow: /*/search?
Impacts:
Site builders, administrators, editors
