Scheduler Widgets Showing for All Content Types after Feature Revert

We used features to deploy changes to multiple environments.

We have multiple content types and configured one of them to use scheduler for publishing and unpublishing.

When I revert the feature with the new scheduler configuration in a new environment, the scheduler widget appears in all node forms.

When I look at the configuration for the content types in which the widget is being incorrectly seen, the configuration looks correct (The scheduler checkboxes are not checked in those content types).

The issue goes beyond the UI. When our code was deployed to our CI server, some of our tests that create content programmability starting failing with this error:

exception 'PDOException' with message 'SQLSTATE[42S22]: Column not found: 1054 Unknown column 'publish_on' in 'field list''