During checkout checking: "My billing information is the same as my delivery information." has no effect

When I try to checkout and select: "My billing information is the same as my delivery information."
I still have to fill in both addresses to be able to check out.

Result is:
First name field is required.
Last name field is required.
Street address field is required.
City field is required.
Postal code field is required.