The Operations Menu for a Taxonomy contains "Edit Vocabulary" but does not contain "Delete Vocabulary".
The Operations Menu for Menus and Content Types contains both "Edit" and "Delete".
I believe the Operations Menu for these two should be consistent within the context of /admin/structure. I've been working with Menus and Taxonomies all day. My preference would be to add "Delete Vocabulary" to the Taxonomy Operations Menu.