Remove button doesn't work

I can add buttons but I cannot remove them using the config options. If I click on a button/service to remove it, it deselects when I hover the mouse over the arrows. Because the actual config is in blobs in the database, I am unable to edit them out that way.