Bulk adding nodes to subqueue moves them to end of other subqueues

If a node which is already in another subqueue (taxonomy) is added with vbo (bulk update "Add to Nodequeues") to a new subqueue it ends up at the end of all its queues (not just the new one).
I think the reason is because the command first removes the node from all queues and then adds it again to the actual queues at the end.
My expected behavior was that the node would stay at its place in all old queues and only gets added to the end of the new queues and of course is removed from queues which are no longer valid. The required behavior would be more an update and not like the actual remove and add functionality.
This would be a great improvement as if the actual behavior is executed on a large set of nodes which are part of lots of different queues all queues have to be resorted. This is a huge drawback as bulk operations should save time and not require time to clean up after them.
I opened a similar issue where I didn't get the error right (which is closed now). So opened this new one with better description. I reference the other one in case of interrest.