For now, just restrict the editability based on whether the user can already add terms anyway.  Later this should be configurable in the widget settings.