It would be nice to enable the Admin to pause the crawler temporarily during heavy traffic or high CPU/RAM usage and the ability to resume crawling when required.
Thanks!

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

mikeytown2’s picture

Added it to the roadmap.

Froggie-2’s picture

Thanks!

mikeytown2’s picture

Title: Allow Admin to pause crawler during high CPU or RAM usage. » Better url_alias behavior in crawler

I think the better option is have the url_alias grab be smarter. Check against the database to see if that entry exists in the boost cache table. If it's not in the table then add it to the url crawler. This would make that setting be smarter and would make the stop crawler setting not as destructive on large runs of the url_alias. Doing a bulk insert for the sql should make it run faster as well.

mikeytown2’s picture

Status: Active » Needs review
FileSize
8.97 KB

Works how it should, just not how I envisioned the first time. This way is a lot faster then before. I need to check the finer points of the SQL before this gets committed.

mikeytown2’s picture

FileSize
9.17 KB

this patch actually works

mikeytown2’s picture

Status: Needs review » Fixed

committed

Froggie-2’s picture

@Mikeytown: Thanks!

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.