Problem

Attempting to batch update mergevars for lists with over 30k subscribers fails due to PHP running out of memory. This will very by server configuration, but the current process is still not scalable as it loads all list subscribers and all associated entities into memory before sending any updates to MailChimp.

Proposed resolution

Refactor the batch update process to load list subscribers and associated entities in batches, updating MailChimp immediately after each batch.

CommentFileSizeAuthor
#2 mailchimp-batch-mergevar-efficiency-2877477-2.patch9.02 KBruscoe
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

ruscoe created an issue. See original summary.

ruscoe’s picture

ruscoe CreditAttribution: ruscoe at ThinkShout for Mailchimp commented
FileSize
mailchimp-batch-mergevar-efficiency-2877477-2.patch9.02 KB
mshaver’s picture

mshaver CreditAttribution: mshaver commented
Status: Active » Reviewed & tested by the community

This was tested with a large batch of mergevars and worked well. if anyone else can test this, this would be a good item to get into the next release.

  • ruscoe committed ced920f on 7.x-4.x 
    Issue #2877477 by ruscoe: Batch list mergevar update fails for lists...
ruscoe’s picture

ruscoe CreditAttribution: ruscoe at ThinkShout for Mailchimp commented
Status: Reviewed & tested by the community » Fixed

We've had success with this on a large site recently. I think it's safe to commit.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.