Cannot edit values in multivalue field

I'm trying to edit a multivalue integer field that I have added to a taxonomy term. It doesn't seem that there is anything wrong with my rules configuration since I am able to change the value of the first item in the multivalue field. However, when I run the same exact rules configuration with the next value, in my example [node:field_reference:field_counter:2], the value is not edited.

I'm pretty sure that rules is getting the correct access to the second value in this field, because I tried setting it to 5 and configured rules to show a message if the number is 5 and it worked. So it seems like rules is not editing values beyond the first default value in a multivalue field.

Anyone know how to fix this? Thanks