Error on first attemtpt of uninstall file_entity module after upgrade core to 8.1.7

I got this problem after upgrading core to 8.1.7.

When I try to uninstall file_entity module first time using drush pm-uninstall file_entity -y I get following error:

[error] Drupal\Core\Field\FieldException: Attempt to create a field field_image_alt_text that does not exist on entity type file. in /var/www/html/core/modules/field/src/Entity/FieldConfig.php:286

If I try to execute same drush command second time, right after error was thrown, It is uninstalled without errors.