Removing a pay to publish item does not delete / remove the node

When at the cart / checkout if I bin the line item for a pay to publish node and empty the cart, the nodes still exist in an unpublished state.