The old "Send all known bots to $args free URLs" method is too aggressive, since it not only breaks AMP support, but also blocks known search engines and bots from accessing content on the site "hidden" behind paging/pagination. We should make it optional, so people could override the @nobots location, if they prefer to.

Comments

memtkmcc created an issue. See original summary.

memtkmcc’s picture

Status: Active » Needs review
StatusFileSize
new2.53 KB

Patch attached for review.

  • memtkmcc committed f847bea on 7.x-3.x
    Issue #2820747 by memtkmcc: Nginx - Support for Accelerated Mobile Pages...
memtkmcc’s picture

Assigned: memtkmcc » Unassigned
Status: Needs review » Fixed

Fix committed.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.