So after asking around a little, I have found that the Drupal.org Community Tools Team has been disbanded. The forums here need some major work to keep them from falling into obsolescence, and the forum section of this team seemed like the best way of getting updates done to the forum, as the barriers to regular users contributing to forum functionality are so large as to make the idea unrealistic. But the team was disbanded, and I don't remember seeing any announcements of this anywhere, and nothing telling us would be in put in place to ensure that the forums here receive some updates to keep us relevant.

I put this post in News and Announcements, because frankly, I'd like an announcement. It doesn't seem right that this initiative to improve the community seems to have been shelved with no announcement on the matter. If I've just missed that announcement, please point me to it. But if I haven't, then I'd request that those who made the decision have some transparency on the matter and tell us what happened, and what is to happen.

Some questions I have:
* Was there an announcement of the disbanding? And if so, where?
* Why was the team disbanded?
* Who made the decision?
* Is there a plan in place to have improvements implemented on the forum? If so, what is the plan, and how far have we moved on this plan?

Comments

tvn’s picture

Last November all DSWG Tools Teams, including the Drupal.org Community Tools Team were merged by DSWG into a single body - DSWG Advisory Group, which consists of subject matter experts behind different parts of the website.

The original plan behind Tools Teams was that they will guide development of their respective sections. As it often happens, the problem was Teams had no resources for an actual development to happen. Staff team is working towards prioritized roadmap for Drupal.org, and eventually we'd get to every section, one by one. But not all at once. In the mean time, Teams meetings were spent discussing plans with no actual development happening. In addition to that, the structure for the teams was not ideal, too different parts of the site were grouped in a single team sometimes. So e.g. maintainers of Groups.d.o had to sit in meetings and listen to people talk about Planet Drupal and vice versa, which is not the best way to spend their time.

To address all of that, teams were merged into a single advisory body - a list of people who have knowledge and expertise in specific areas of Drupal.org. Now *when* staff team gets to work on a specific area of the site, we go *directly* to people who have expertise in that area and ask for their input and feeback on work plans. Instead of making a bunch of busy people spent time in lots of meetings, sometimes not relevant for them. As an example, a few weeks ago we had a call with Groups.d.o maintainers and webmasters regarding future plan/ D7 migration for that sub-site.

As for forum improvements, currently our focus is implementing changes to Drupal.org content strategy and IA, based on a user research, which happened last year, and content strategy work, which happened earlier this year. Starting meta issue for this work is #1133434: [META] Content Strategy for Drupal.org, and there are lots of child issues. Those changes will touch and improve all areas of the site, including forums. Again, such a big change can't happen very quickly, we are currently working on About Drupal/Why Drupal area. I do not have ETA at moment when we'll be working on forums. But when we do, this definitely be announced, and those interested will be able to provide feedback.

jaypan’s picture

Thank you for the reply.

Edit: So I've sat on this for a little bit before making my full response.

Every few months, someone brings up the idea of moving full support over to Stack Overflow. Until now, I've strongly resisted this, as I think it would be embarrassing that the main Drupal site, literally brimming with Drupal developers, wouldn't be able to develop whatever functionality would bring the Drupal forums up to whatever standard we want/need.

Last year, I went on a mission, trying to develop functionality for the forums. I had a full roadmap of things that I felt needed to be done, and if no one else was going to do it, I would. But I quickly hit the bureaucratic wall. It took months and months to get small bits of code that I wrote to even get acknowledged for existing. One simple change I made, showing forum descriptions on the forum create page, sat for four months before I finally got fed up and made a comment that got someone to look at it. So I gave up on development. It was disheartening, trying to improve something I care about, only to have it ignored because the people who needed to check it don't care enough about the forums to do so in anything that could even exaggeratedly be called a timely manner.

I thought the Community Tools team was a great thing - finally we'd have someone focused on moving the forums forward. I waited for months to start seeing some changes. Finally I wondered what was happening, and after asking around, I found that the team was disbanded (which led to this thread).

Now, with tvn's announcement, I see that the forums are, as usual, down at the bottom of the priority list. I don't know when they will get attended to, but it doesn't sound like it's going to be any time soon.

These forums are sadly behind the times. We have:
1) A spam problem
2) A lack of people to deal with the spam problem (it sits there for hours on the weekends)
3) No notification system
4) Unapproved posts that take up to 4 weeks to be approved
5) No way of promoting good posts, and demoting low-quality posts
6) No ajax posting
7) A lousy spam reporting system
8) No ajax spam reporting
9) Almost no other ajax functionality
10) No inline-message editing

And these are just a few off the top of my head. The problem is, it's almost impossible for people who are committed to the forum to deal with these issues, and the Drupal organization doesn't use the forums, and doesn't really seem to care about them either. We get the occasional announcement, and that's about it. This isn't fair to those of us who have been committed to them, both the people helping, and the people looking for help.

So I personally am putting my backing behind closing the Drupal forums, and using Stack Overflow as the primary source of Drupal support. It's become clear to me that the Drupal organization has a bureaucracy issue, combined with a lack of interest in the forums, that has essentially allowed them to linger into obsolescence. It pains me to say this, after years of trying to support people literally every day on these forums, but if we are going to provide quality support for people who need help, we need a platform that wasn't outdated 10 years ago. It's sad, but if we are not going to use the forums as an example to show what can be done with Drupal, then we should stop allowing them to be an embarrassment.

So my question is, how do I petition the Drupal organization to make this move? And who else is with me? Let's move Drupal support into the current age, instead of hanging out in 2003.

Edit 2: Or if you're not with me, then please give your thoughts on what we need to improve here. And if you have any ideas on how can we get past this bureaucratic nightmare and move our forums up to this decade I'd love to hear them too. I'm not entirely sold on moving to Stack Overflow. But I am sick of the pathetic excuse for a forum that we currently have. Let's get some conversation happening, because right now nothing is being done, nothing is being said, and no support is being given.

Contact me to contract me for D7 -> D10/11 migrations.

john_b’s picture

I pretty much agree with all the complaints made be Jaypan. A look at his tracker will show he has contributed a lot (hundreds, if not thousands of hours), so he knows the situation well. My own tracker showing support posts may also be consulted by anyone interested, and if anyone feels some initial anger with out views, it may be worth checking that we have contributed a lot just to show we are not among the many who complain from the sidelines.

My own experience of writing many support posts over several years has had several consequences, many of the good. One of the consequences is a clear view that the support forums are 'dying on their feet' and that the chances of getting this slow decline reversed are slim. Some of the reasons for this are good reasons: the needs of the increasingly enterprise-oriented software that Drupal is (IMO) are different. Nevertheless, the situation is bad for the perception of Drupal and for the adoption of Drupal.

I agree with Jay to this extent: yes, the people who could do something have a lot else on their hands. It is also true that there feels like an institutional brick wall, which is probably not anyone's fault, which leads to wasted effort, and makes me despair of progress. Even a small thing, like an email notifying users when their question has received an answer, seem far out of reach. This means that of the hundreds (?thousands) of hours I and others have spent answering support requests, it appears that many of our answers have not been seen.

The value of the loss? Given the rates I know that Jay and I and other frequent contributors can and do command in the market for Drupal services, if these 'wasted' posts (wasted because the lack of a notifier means they are not read) were reduced to 'what they would have cost to write commercially', the sum is very large - large enough to have made a big dent (or more) in the Drupal8 Accelerate budget.

I rarely write in this way, because I have become fatalistic about it. Move to Stackexchange? This is tricky as the system there does not suit the newbies we support, though it would work for the many support requests we get from people with more experience in software. On balance it might not be a bad idea.

Digit Professionals specialising in Drupal, WordPress & CiviCRM support for publishers in non-profit and related sectors

jaypan’s picture

Thanks for your comments John.

Contact me to contract me for D7 -> D10/11 migrations.

holly.ross.drupal’s picture

First - thank you two. I see you guys both all over D.O and am really appreciative of all the feedback and help you two provide.

Second - I feel your pain. Drupal is so big, and D.O is just huge. We have a relatively tiny number of staff who can focus on it, and a volunteer bas that is AWESOME but spread too thin. I know forums are very neglected, especially since we are focused on D8 release blockers like localize.d.o and Drupal CI right now.

I see that Tatiana shared what happened from the perspective of the working groups. I will have the team think about the larger issue. I know (vaguely) that forums are going to eventually get some attention because of the content strategy (you can see an overview of the content strategy from DCon LA here: https://www.youtube.com/watch?v=lMg921f80gY&index=20&list=PLpeDXSh4nHjRw...).

That said - I know that whatever bits of gain forums gets from this process, they won't be super significant. Jay - you have been a great contributor to Drupal.org and we've probably committed more of your patches than anyone else recently. If we're not getting to anything in particular, please let me know.

jaypan’s picture

Hi Holly

Thank you for taking the time to get involved in this. I'd like to respond to a few of your comments.

Drupal is so big, and D.O is just huge. We have a relatively tiny number of staff who can focus on it, and a volunteer bas that is AWESOME but spread too thin.

The problem here is threefold. The first is that the volunteer base, is spread thin (as you have said), the second is that almost none of them use the forum, and therefore it is very low on their priority list, and the third is that the barrier to contributing in their stead, is near insurmountable.

I accepted a few years ago that the people who work on Drupal.org were not going to do much for the forums. So I as I mentioned in an earlier post, I decided to take care of it myself. What initially got me was that when I asked how to report spam, the process was a huge barrier to actually doing it - users had to find and go to the webmaster's queue, then post a new thread there. I couldn't understand how the people who were maintaining the forum would care so little about spam, as to not have a method of reporting it filled with such a barrier. But I don't like to be that guy who just complains, without providing a solution. And since I know how to develop for Drupal, I decided to do something fairly simple - add a link to nodes and comments that would link to the webmaster's queue, with the appropriate fields already filled out, so the user could just click submit. A two-click process to report spam, removing a large part of the barrier to doing so.

However, upon making that decision, I ran into the following barriers on developing for Drupal.org

  1. There was no documentation anywhere on how to do it.
  2. Someone mentioned a module that contained all the DO enhancements (I don't recall what it was called). So I downloaded that, and made my modifications.
  3. Upon submitting it, I was told that this was the incorrect method, and that I needed a Drupal.org staging environment. So I applied for and received one, then re-did all the work I had already done.
  4. I created my patch, and submitted it. And waited. And waited. And waited. Then I started bumping it, and the infrastructure team got angry because I kept bumping the thread (I believe you may have even come into that thread to clean things up).
  5. Finally after months, my patch was approved and installed.

Even after that frustrating process, I decided to try to continue. I created some more patches, and submitted them. As I mentioned in an earlier post in this thread, one of the simple ones sat for four months without getting acknowledged whatsoever. And that was for something really simple - I had ideas for much, much more complex functionality, but with a response time of 4 months, any iterations would have taken years to get through before any functionality could be implemented. Others patches I made sat for even longer, and as far as I know, are still sitting there. I created a patch for ajax forum replies. We still don't have ajax forum replies. And I left it in a nearly completed state. It needed some work, but I gave up, and no one else ever bothered to even pick it up and try to complete it.

So as you can see, it's basically impossible for people who aren't part of the inner circle to contribute, and those who are part of the inner circle don't contribute. Which has led to this stale forum that was outdated a decade ago.

That said - I know that whatever bits of gain forums gets from this process, they won't be super significant.

And this is the problem.

Jay - you have been a great contributor to Drupal.org and we've probably committed more of your patches than anyone else recently. If we're not getting to anything in particular, please let me know.

First off, I gave up on the process. My development server was shut down months ago (maybe even a year). It was a soul-destroying process. I was trying to do something, because no one else would, and I faced barrier after barrier, followed by being completely ignored.

And going on to my contributions, let's look at the last five improvements to the Drupal forums that I can remember (there may have been others that I am just not remembering or haven't seen/noticed):

  1. New user roles
  2. Showing forum descriptions on the 'Forum Topic' create page
  3. Removing the 'Create new topic' thread from the forum top page, and having the new topic link on each forum automatically fill the forum name with that forum when creating a new topic
  4. Report spam link
  5. BUeditor (WYSIWYG) added to the forum create page.

#1 in the list wasn't really forum specific, though it did tie in with the forum significantly
#2, #3, #4 were all submissions by myself
#5 was about three years ago

You can see that if you take my contributions out of there, almost nothing has been done with the forum for years.

This is why I think we have the following options:

  1. Close the forum, and redirect users to Stack Overflow
  2. Remove the bureaucracy for regular users in getting improvements added to the forum
  3. Have the inner-circle commit to focusing more on the forum, even if they don't care about it
  4. Leave it as-is.

#1 is not a great option, as Stack Overflow often has lots of attitude, is not as welcoming to newbies, and we lose all control whatsoever over Drupal support. On the plus side, they actually care about their infrastructure, and it's a nice interface, with lots of quality features, that make it easy to find what you need to know when you need to know it.

#2 and #3 require some sort of effort from the inner-circle.

#4 is the path to apathy, and frankly, is an embarrassment to the Drupal community - that a community of people who are focused on developing with Drupal cannot even make a forum beyond was was available at the turn of the century.

Hence my frustration.

Contact me to contract me for D7 -> D10/11 migrations.

jaypan’s picture

Well, the lack of reply shows that #2 and #3 are not going to happen. #4 is ridiculous. So I go back to my original question as to how we can petition to switch from using the Drupal forums to moving to Stack Exchange.

Can one of the inner circle please direct us to how to petition to make this change? Thank you.

Contact me to contract me for D7 -> D10/11 migrations.

jaypan’s picture

I've opened a ticket in the webmaster's queue regarding the petition to drop the Drupal forums, and move to Stack Overflow. You can follow it here: https://www.drupal.org/node/2536122

Contact me to contract me for D7 -> D10/11 migrations.

WorldFallz’s picture

just cross referencing, I added my reply to the issue. No reason to repeat it here.

jaypan’s picture

Interesting. Someone just emailed me this after reading this thread: http://blog.boombatower.com/woes-testbot

It looks like I'm not the only one who has faced major barriers as one outside the inner-circle.

Contact me to contract me for D7 -> D10/11 migrations.

vacilando’s picture

A relevant little personal experience:

Pretty much after I joined Drupal.org (and it was almost a decade ago) I reported a bug regarding the forum in the sense that notifications were not being sent when there was a reaction in a thread in which one participated.

The answer was that it's not a bug but a lacking feature.

Knowing that I rarely ever posted much in the forums -- I was not going to go to the trouble of having to remember to keep returning to a page just to see what the reactions were (if any).

I know there are opinions abound, but to me this lack of (auto-)subscription to a thread is the single most important (and so simple!) feature making the d.o. forums nearly useless. I still sympathize all the poor souls who post questions in forum not realizing that there is nobody but search engine crawlers following the threads, and that even if there is an answer they will never get a notification.

I admire you, Jaypan, for having done so much in terms of new patches for d.o. I hope you will not give up. Remember that, ultimately, d.o. is a website of the community, disregarding who sets the priorities at helm right now.

jaypan’s picture

I admire you, Jaypan, for having done so much in terms of new patches for d.o. I hope you will not give up.

Thank you, I appreciate that. To be honest, this is likely my last effort before I do give up. But I want to make sure I've exhausted all possible avenues before I get to that point. I appreciate your comment about this being a community, but a community needs support from it's leaders to function. If we can't get that support, then it's not a community that I want to be a part of anymore.

Please note that we have continued the conversation here: https://www.drupal.org/node/2536122

Contact me to contract me for D7 -> D10/11 migrations.

susan5in7’s picture

I’d love to stay with you Jaypan.

You have stamped your personality on your work. Pitched your ideas for creative guidance. You have supported for the sake of Drupal Support, You have written from your heart.
I have a great admiration on you. I have learned a lot from your contribution. I have studied max. of your patches, I have followed your guidance and now I have gathered lots. Now I have got a feeling that I can do anything with Drupal whatever I want. My special thanks to all tireless contributors like you to make the Drupal strong and beautiful.
Removing Forum from Drupal will be a great pain. All Drupal Buds are glowing through support from Forum. But it has been ignored for a long time and still they have no time to look after.

jaypan’s picture

Thank you, your comments are much appreciated.

Contact me to contract me for D7 -> D10/11 migrations.