Problem/Motivation

We would like to have an option to list specific user agents, their request should be blocked when meeting the required parameter limit. In that way we can allow a strict parameter limit for user agents and still allow access for human users.

Steps to reproduce

Proposed resolution

Remaining tasks

User interface changes

API changes

Data model changes

Command icon Show commands

Start within a Git clone of the project using the version control instructions.

Or, if you do not have SSH keys set up on git.drupalcode.org:

Comments

aren33k created an issue. See original summary.

aren33k’s picture

Status: Active » Needs review

This can be reviewed.

bburg’s picture

I worry this is a very brittle approach. I've spent a lot of time staring at access logs over the last year, and I've seen a big issue is that these bot requests are coming from many different sources, with requests that do include known bots, but seemingly more often from what some WAF services call "Browser impersonators", which can be a combination of any versions of OS and Browser. That's just going to be too diverse to capture with a straight string matching comparison.

I might suggest checking string position, or a regex comparison instead? There is also the Crawler Rate Limit module, which can rate limit bots, outside of a faceted search context.

bburg’s picture

Status: Needs review » Needs work

aren33k changed the visibility of the branch 3559489 to hidden.

aren33k changed the visibility of the branch 3559489 to active.

aren33k’s picture

Status: Needs work » Needs review
aren33k’s picture

Assigned: aren33k » Unassigned