Path productcatalog/xml can be indexed by any search engine, but most visitors won't understand XML.

It would be nice to exclude this path from search engine search results.

See also: https://yoast.com/x-robots-tag-play/

Patch will follow.

CommentFileSizeAuthor
#2 prevent-search-bots-2564439-2.patch561 bytestessa bakker

Comments

Tessa Bakker created an issue. See original summary.

tessa bakker’s picture

tessa bakker
she/they
Primary language Dutch
commented
Title: Exclude path 'productcatalog/xml' form search engine crawlers. » Add header to prevent search bots from indexing productcatalog/xml
Status: Active » Needs review
StatusFileSize
new prevent-search-bots-2564439-2.patch561 bytes
Danny.Wouters’s picture

Danny.Wouters commented

The solution looks good

mrharolda’s picture

mrharolda commented
Status: Needs review » Fixed

Tnx! Committed to -dev.

@Danny, if something looks good, please change the status to "Reviewed & tested by the community".

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.