Branching off of #2938949: Improve / "fix" the gender field

One of the first steps we want to take is actually implement the Big 8/Big 10 self-identification options that we've been using for DrupalCon speakers. Those are:

I identify with the underrepresented communities in the following categories: *
Ability - Behavioral, Cognitive, Emotional, Physical
Age
Ethnicity
Gender
Gender identity
Race
Religion
Sexual Orientation
Socio-Economic Status/Class
Learning Differences
Family Composition
None
Prefer-not-to-answer
We have chosen these categories based on the Big 8, which is a list of cultural identifiers

This will likely take the current place of the gender field on sign up - giving us a broader set of demographic information about our newly registered users. The gender field itself will still need to be addressed in #2938949: Improve / "fix" the gender field

____________________

Current live implementation:

Screenshot of welcome page form

Which also links to this page for more information about each category and why we collect this information: https://www.drupal.org/drupalorg/docs/user-accounts/demographic-information

Support from Acquia helps fund testing for Drupal Acquia logo

Comments

hestenet created an issue. See original summary.

  • drumm committed 65f36d9 on 7.x-3.x
    Issue #2938949: Remove the gender field from the welcome page...

  • drumm committed 4c73dc2 on 7.x-3.x, dev
    Issue #2940759: Export to match production fields
    
  • drumm committed 516e6ab on 7.x-3.x, dev
    Issue #2940759: Show extra big 8/10 representation information...

drumm credited B_man.

drumm’s picture

Status: Active » Fixed

This has now been deployed to Drupal.org.

catch’s picture

The new field has both 'Gender' and 'Gender identity', but the list above does not. It's also not listed on https://www.isdnetwork.org/what-is-diversity.html which is given as the source. Is this Big 10 (which I can't find a reference for) or something else?

rachel_norfolk’s picture

I added it, Catch.

It struck me that we want to check we are including people that are either/both under-represented by virtue of their gender or their gender identity being something other than what they were assigned.

As an example, I personally ticked both boxes but a trans guy friend of mine would (if they choose to, of course!) tick only the gender identity box (cos being a guy isn’t under-represented in our community)

catch’s picture

So gender identity isn't equivalent to trans though. Cis people have a gender identity that's the same as the one assigned at birth. Trans and non-binary people have a gender identity that is not the same as the assigned at birth one.

Only one group experiences discrimination based on this, but the field itself looks very not self-explanatory to me as it is.

Or to put it differently, there is discrimination based on gender identity, but the people that are discriminated against are trans or non-binary, they are not 'gender identitied' since everyone has a gender identity, and there is not a 'gender identity' community but a trans/non-binary one. People with a gender identity are not under-represented because literally everyone has one.

For 'gender' it really means 'not a man' - people aren't discriminated against because they have a gender, they're discriminated against because their gender is not male in a patriarchal society.

So at the moment it's conflating the groups of people discriminated against (the 'communities') and the axis by which discrimination happens. This applies to all the categories, for example just the word 'race' doesn't tell you much especially on an international form - if you're Japanese and live in Japan should you put race or not?

catch’s picture

Status: Fixed » Needs work

Just re-opening so the feedback doesn't get lost. If a new issue is better, I can create one and post it there.

RainbowArray’s picture

I 100% agree with catch that the biggest problem with this form is that it's not achieving its goals, because the options for people to select are not underrepresented groups.

Gender identity is not an underrepresented group, but people who are trans are certainly underrepresented.

This is true for race, gender, gender identity, and heck every option here. Actually be explicit about which groups of people are underrepresented! And glomming everything together seems not terribly useful. In the US, I'd assume the "race" option is a catch-all for anyone who is not white. But there are meaningful differences between anti-black racism, anti-Hispanic racism, anti-Asian racism, etc. It would be meaningful to know if our community has more people of color who are Asian or Hispanic, but not as many black people, for example. Because that would identify a gap that we could look at and work on improving.

As it currently stands, I don't think the data this form is collecting is meaningful. It's crucial for this form to be improved before it is promoted to the public.

hestenet’s picture

I would highly encourage folks to read the motivation behind the development of the Big 8/Big 10 categories because it addresses several of these concerns: https://www.isdnetwork.org/what-is-diversity.html

Namely - it addresses intersectionality and a broad base of representation in a relatively lightweight way without other-ing people by leaving them out of a supposedly comprehensive list of identities. (which is doomed to fail to be truly comprehensive)

This was first trialed with our speaker registration forms for DrupalCon and has been successful there in providing us meaningful data about our speaker make-up.

That said - no effort is ever perfect from the get-go - so I'm sure we can make improvements, and this is well-thought-out and well-meaning feedback, so thank you.

catch’s picture

I see the list of them and a glossary of other terms on that page, but not an explanation of their development or how they can be used for data collection - did you mean to paste another link?

hestenet’s picture

I see the list of them and a glossary of other terms on that page, but not an explanation of their development or how they can be used for data collection - did you mean to paste another link?

You're right that the page I linked isn't as detailed as what I remembered. I'll go back through my notes and see if I can find a link that digs into the underlying motivation behind that construction. There was a great discussion of intersectionality and this construction being designed precisely to avoid (or try to) the problem of exclusion by oversight.

Actually be explicit about which groups of people are underrepresented!

I don't disagree this in principle at all. It's a good idea - and we try to give more comprehensive examples on the documentation page linked from the field (which, for that matter, can be more easily updated with additional explicit identifiers, not just by us but by other members of the community, and without a code deployment).

As it currently stands, I don't think the data this form is collecting is meaningful.

On that point, I disagree. Yes there are meaningful differences between different types of racial discrimination for example, and meaningful differences between how a person of one ethnicity might feel unrepresented in one part of the globe and not in another - but even the categorical information can tell us --- 'No one who identifies as part of an underrepresented ethnicity signs up for an account - something's going badly wrong.'

There are a few pragmatic issues here we're balancing (which, to be absolutely clear, do not outweigh the underlying need to get this right) - namely:

  • How do we source a comprehensive list of axes of identification and specific identifiers without resorting to categorical groups like the Big 8/10/12, and yet avoid exclusion by oversight? A catch-all textbox for anything we might miss has already been firmly rejected by some members of our community as othering. Even efforts like the excellent open demographics initiative, will inevitably struggle to be complete.
  • The principle of 'if it's not our business, and doesn't directly help the user, we shouldn't ask.' Using categorical representation a) does not enforce our norms of what 'counts' and b) doesn't ask for more data than we would be able to meaningfully act upon once we aggregate it together to try and address what it reveals about our community.
  • Balancing explicit affirmation of identity against making users feel forced to out themselves (even in a private field).

This is all not to say that this is even good enough yet - but it's light years better than what was there before and I think we have no other option but to incrementally improve on this. It's too great a challenge and too important than to presume we can get it right all in one go.

hestenet’s picture

Updated the issue summary with a screenshot of what the field looks like on the new account welcome page and a link to the docs, since that page isn't visible to users who already have an account.

RainbowArray’s picture

What sort of user testing was done on this change?

Were people from underrepresented groups consulted about whether or not *they* felt that this was useful across all of the various axes?

I've already had one person reach out to me about feeling very dissatisfied about this form and have had discussions with numerous other people that feel similarly.

I don't see anything on that ISD page that indicates that even if these are axes of ways people feel underrepresented that simply asking people to select one or more of the axes names is a useful way to collect this data.

The Open Demographics questions have much more clear rationales for what is asked and how to ask it: https://drnikki.github.io/open-demographics/

Particularly since that is an effort that is being worked on by a Drupal community member, it seems like a much more sensible source to use for something as important as this.

Many people brought up having an option of either deciding for each question whether or not that information should be public, or better yet, to be able to provide a separate public answer if a person so desires, on https://www.drupal.org/project/drupalorg/issues/2938949

It's frustrating that this was deployed in this current state after numerous people gave feedback that these options were not sufficient.

hestenet’s picture

@mdrummond I'm afraid we're talking past each other a bit, and I'm sorry for that 🙁 I think we're actually argue-agreeing with each other.
It's a critically important topic and that gets tense.

In terms of why this was 'rushed out the door' as it were - you actually summed it up really well in the other issue:

Agreed that the top priority is getting rid of the terribad gender field stat. Don't wait for the perfect solution before correcting a serious problem.

Our intent was to stop the bleeding with a fast-response first step, so that we can then go back and make better, more thoughtful, more impactful improvements. That's part of why that other issue is still open - we don't consider this issue to have resolved everything by a long shot.

So please understand that this is a step not the final answer.

What sort of user testing was done on this change?

  1. Consultation with specific individuals, both in public fora, such as these issues or slack or twitter, and in private
  2. Our own analysis of use of these same fields on the speaker session submission form

Were people from underrepresented groups consulted about whether or not *they* felt that this was useful across all of the various axes?

  • Yes people with lived experience in one or more of these underrepresented groups were consulted. Not every group/axis, but as many as I was able to reach out to.

The Open Demographics questions have much more clear rationales for what is asked and how to ask it: https://drnikki.github.io/open-demographics/

Yes! And as I've tried to say before/said in the other issue (which is pointedly still open for a reason) I think the open demographics initiative is wonderful and we should implement it.

This change was a first step because what we were already asking was actively harmful and offensive. Now it may very well be non-specific enough, but I'm hopeful that it is at least not actively harmful.
________
Pragmatically - to move this issue forward what would be really helpful are suggestions on how to implement the Open Demographics initiative questions.
- Can we find a way to put them on the welcome page without it becoming way to unwieldy? Or do we need something shorter on the welcome page, with a whole fieldset/vertical tab for the complete Open Demographics on the profiles themselves?
- Can we build an integration that automatically pulls in more answer options from Open Demographics as that repo continues to be updated?
Some thought needs to go into how to do it right now that we can slow down a bit.
In retrospect - maybe it *would* be a good idea to close this issue and open a follow up for "Implement Open Demographics Initiative" or rename the "Fix Gender Field" issue to that more broad title.

hestenet credited drnikki.

hestenet’s picture

Status: Needs work » Fixed
Related issues: +#2971410: Implement Open Demographics Initiative on Drupal.org

Following conversations at DrupalCon Nashville with @drnikki and @sparklingrobots, I've decided to go ahead and spin off a separate issue for the next step #2971410: Implement Open Demographics Initiative on Drupal.org

Going to close this issue as our temporary fix while we're moving in that direction.

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.