Views Format Grouping cannot be unique per Display

I have a View with three displays. Two of them have fields coming from two different taxonomy vocabularies.
When I click on Format ... Settings, and set the Grouping field Nr.1 in Display1, it wipes out whatever was stored in Grouping field Nr.1 on Display2.

I looked at the output of the Configuration Manager.

It looks as if this grouping data is stored under the:

display:
  default:

section of the file. (In my case the file is called views.view.work_page_grouped_content.yml)

The section of code that contains my Grouping information in the YAML file looks like this:

      style:
        type: default
        options:
          grouping:
            -
              field: field_services
              rendered: true
              rendered_strip: false
          row_class: ''
          default_row_class: true

I tried to remove that from under default, and manually change those in code to be under their respective displays.
(Basically a copy/paste and rename the field)

It looks like I'll have to create multiple Views if I want to use the Grouping field feature.