Problem/Motivation

robots.txt syntax checking link broken

After submitting site url at

# For syntax checking, see:
# http://www.sxw.org.uk/computing/robots/check.html

The requested URL http://www.dcs.ed.ac.uk/cgi/sxw/parserobots.pl is not valid.

Proposed resolution

patch with working robots.txt syntax checking link submitted

I have tried this robots.txt syntax checker, it is a good one:

http://www.frobee.com/robots-txt-check

Remaining tasks

review and test patch

User interface changes

syntax checking link changed in robots.txt file

API changes

none

Comments

decibel.places’s picture

decibel.places’s picture

Issue summary: View changes
Status: Active » Needs review

edited to use Issue Summary Template

decibel.places’s picture

Issue summary: View changes

clarify Problem

jhodgdon’s picture

Status: Needs review » Closed (duplicate)

Please do not file the same issue for Drupal 8, 7, and 6. File it in 8 and tag appropriately. Closing this as a duplicate of #2276469: robots.txt syntax checking link broken.