One of the most important lessons of 2015 for the Engineering Team here at the Drupal Association is that we need better ways to engage with you, the community. We realized we need better tools and ways to communicate with you about our current priorities, how you can influence those priorities, and how you can help make Drupal.org and the Drupal project better than ever.

All of the work we do stems from the mission of the Drupal Association. It's our duty and responsibility to unite a global open source community to build and promote Drupal. As the home of that community, and the codebase, Drupal.org is perhaps the most critical piece of that mission, and at the most basic level all of the initiatives we prioritize must support that goal.

As part of reviewing our work in 2015, and in the interests of being transparent with the Drupal Community, we revamped the Drupal.org Roadmap. As you can see, we chose to focus on the few, most important initiatives that we have the capacity to execute on in the near term. We're also including upcoming initiatives that we will move into as the active work is completed, but not as many as we had previously displayed. An important lesson of the past year is that we have to be Agile on the macro scale as well as on the micro. The needs of the community can change rapidly and we need to be able to respond.

Current

These are the initiatives the Drupal Association technology staff is focused on now.

Next

These are the initiatives the Drupal Association staff will work on or support once the Current initiatives are completed. The order of these initiatives may change.

We've also added some new iconography to indicate where some of these initiatives come from.

Initiatives with the tools ( ) icon represent essential support and maintenance work. This can mean paying down technical debt in the Drupal.org codebase, performing server maintenance, or implementing cost saving measures to help fund the rest of our mission driven work.

Initiatives with the community ( ) icon represent initiatives that were directly proposed by members of the community and/or are being supported by volunteer work from the community.

Don't all the initiatives come from the community?

Yes, all of our priorities come from the needs of the community - but the community is a loose collective of many different groups of people with many different needs and priorities.

The needs of Drupal newcomers are vastly different from those of the Drupal Core Maintainers. The needs of our documentation editors are different from the needs of those providing support on the forums. And all of these needs must cohere with a larger product and design vision for Drupal.org to make this home of the community a cohesive, efficient, and beautiful place to be.

The Drupal Association Engineering Team can be thought of as the maintainers for Drupal.org and the sub-sites. It's our duty to synthesize these diverse needs and to prioritize the major initiatives that will have the highest impact for the community. It's also our job to make the architectural decisions for Drupal.org to ensure that every aspect of the site is functional/useable, consistent, and maintainable.

Most of our priorities, therefore, we set ourselves by bringing all of these factors together and doing the best we can to have the biggest impact, not just on the most vocal parts of the community, but also on those parts that are sometimes siloed or overlooked.

All that said, the community is absolutely a vital part of creating our initiatives. The maintainers for any other project on Drupal.org do not act alone - they accept feedback and contributions from other contributors, while at the same time making key architectural decisions, reviewing patches, and ultimately deploying that work in the form of new releases. We do the same with our initiatives.

Community Volunteers and Community Initiatives

There are two ways that members of the community can have a direct influence on the Roadmap for Drupal.org. These methods have existed informally in the past, but in 2016 we'd like to beta test some new ideas to make these processes more formal, consistent, and transparent.

The first way is to volunteer your expertise to help with one of the existing initiatives we already have prioritized, or even to offer your expertise without a particular contribution in mind. There is a strong record of community volunteers helping to improve Drupal.org, just a few examples from the last year include: u/mlhess and u/nnewton helping with infrastructure; to u/michelle helping to clean up spam; to u/dddave and others in the webmasters queue; or u/mshmsh5000 who helped with Drupal Jobs feature development.

If you have expertise (and not just in code!) and are ready for guidance from the Drupal Association engineering team as to how you can help, you can offer your assistance as a volunteer.

Learn about Volunteering

I should also note - we strongly encourage most volunteers to first consider giving back to the Drupal project itself, but we are certainly happy for help with Drupal.org

The second way to influence the Drupal.org roadmap is to develop a community initiative. If you (and perhaps a small team of others in the community) have some expertise in a particular area, and have a particular initiative in mind that you would like to work on, you can propose a community initiative.

View Community Initiatives

Community initiatives come in all shapes in sizes: from documentation audits with the help of u/dead_arm; to adding two factor authentication to Drupal.org with u/coltrane; to a much larger task like building and deploying DrupalCI with the help of u/jthorson, u/nickscuch, u/ricardoamaro, u/bastianwidmer and several others. Some initiatives affect a subset of the community, project maintainers, for example, whereas others may affect almost every user.

Why this new process?

The hard lesson we've learned over the course of the past year is that we need to be involved early. Even in cases where the community volunteers driving an initiative forward are experts in their area - if Association staff are not involved early in the architectural and planning decisions then what should be a positive, collaborative effort is often slowed down by architectural refactoring and design decision backtracks. That is not fun for anybody, and our immense respect for our community collaborators requires that we set them up for success by getting involved early.

As such, our new community initiatives process has several steps:

  1. Community members plan their contribution in an issue, and identify who (if anyone) is able to volunteer some time to make the contribution.
  2. The community members propose their initiative to the Association - so that we can evaluate it for inclusion on our roadmap. This may include a call with the community members proposing the initiative to talk it through in greater detail.
  3. Association staff evaluate the initiative: prioritize it into the roadmap, postpone it, or--if necessary-- reject initiatives that are not a good fit.
  4. Prioritized community initiatives are rolled into the larger Drupal.org roadmap, and monthly or bi-monthly community initiative meetings are scheduled to ensure the work moves forward.
  5. A liaison from the Association engineering team is assigned, to help coordinate architectural decisions, to provide support and access as needed, and to coordinate with the larger team when it is time for the work to be reviewed.

This process is time intensive - and so in general we expect to be able to run only one or maybe two community initiatives at a time, in parallel with our other work. We realize this may be frustrating, but the last year has shown that our most successful initiatives required this close coordination.

This process is new, and will evolve

Finding a good process for working closely with such a diverse and passionate community is not easy—and we aren't assuming that this new process will be perfect. We're going to trial this new community initiative process in 2016 with the goal of increasing the transparency of how we prioritize our work, and how the community can help us build a better Drupal.org. We are committed to making this process better.

Comments

Liam McDermott’s picture

I don't see the point in this if initiatives (like forum improvements) are denied by the DA for spurious reasons and the many hours people like Jaypan and WorldFallz spent on their initiative are wasted.

It seems the focus of Drupal since Acquia came into being (though it's not entirely their fault) is the Enterprise market. I remember ye olden days when Drupal developers laughed at 'enterprisey' software, now the initiatives the DA chooses seem to be for the benefit of Enterprise level users, instead of people working on smaller sites.

It's just sad, coming back to Drupal and finding all these shenanigans going on.

nithinkolekar’s picture

+1
Smelling the same thing .. Remembers me MySQL era

leoklein’s picture

Wondering if I would've picked Drupal back in 2004 if this had been the modus operandi.

Jaypan’s picture

Thanks for the comment Liam.

And you'll notice that there isn't a single mention of improvements to the forums in the entire post. Even though we are nearing 100 people who have agreed that the forums need improvement.

Mixologic’s picture

Jaypan’s picture

Kind of, but not really. That reads that they are just planning to drop the forums altogether:

Support forums will be migrated into Q&A support system

Which makes me even more depressed.

Mixologic’s picture

I don't know for sure, but I feel like that the link is somewhat of a placeholder, and is probably pointing to some relatively out of date information (july 2015?). I believe the sentiment is "New drupal users need somewhere to go for support, this is the section that houses that support". I think all the discussions surrounding forums vs. Q&A surfaced that there is a need for both types of support, and that Q&A and forums serve different purposes entirely and not interchangeable, but both of them would be "support". The community icon next to the initiative indicates to me that the people involved with supporting new users would be involved in helping shape the features and identify the requirements, and possibly even some of the implementation.

WorldFallz’s picture

I think all the discussions surrounding forums vs. Q&A surfaced that there is a need for both types of support, and that Q&A and forums serve different purposes entirely and not interchangeable, but both of them would be "support".

That was my thinking as well and my approach when I was on the, now disbanded, community tools team-- see this google doc for my original proposal.

I also already had a prototype of a Q&A support site built entirely in D7 and was beginning to work on the improvements to the forums (best answer, up/down voting, more user info in posts/comments, etc) when the plug was pulled on the entire team.

nithinkolekar’s picture

I don't get why they have started forum when we could address issues/queries at modules directly? May be because I started using drupal from version 7 and I don't know how was the scenario earlier.
Like I already stated module specific queries and issues can be submitted for seeking solution(?) then why we need again forum? Users (including me) will definitely look into forum when..

1. Switching from other CMS or starting with drupal and they needed the guidance for setup/troubleshooting.
2. Migration help : from/to drupal/other CMS versions, VPS servers, Mysql to postgresql etc.
3. We encountered some problem when there are multiple modules are getting involved and couldn't get which module is causing this.
4. Features and distribution help
5. postmortem existing drupal site: what modules are used in that site to accomplish the task? ( this will definitely attract the new user towards drupal)
6. We don't get solution at modules issue queue.
7. Tagged issues/thread just like SO.

at the end we do need forums ...

dddave’s picture

The creation of sections is part of a much larger undertaking in massively restructuring how drupal.org is organized. As one of the most active volunteer webmasters I was privy to a presentation about this last year and it is one hell of an undertaking that if ever completed would benefit drupal.org in unparalleled ways. (So +1 for me for the vision and the goal).
The whole restructure is cleverly constructed following the different personas of drupal.org users and makes a lot of sense (if it ever comes to fruition).
However I didn't get the feeling then and certainly not in the meantime that the "Learner" persona (or newbie or small-time coder, hobbyist etc) has a role of focus.

And yes, this issue is a placeholder for when these things start to become "real".

hestenet’s picture

The intent of that placeholder issue is absolutely to encompass the scope of forums, Q&A, and likely other elements that encompass the Newcomer/Learner experience. We anticipate the larger 'support system' to be a one of the major priorities - and to based in large part on the large amount of community input we've already seen. And for what it is worth - I've taken back up and reviewed the detailed work that @Worldfallz did to define user stories for the functional features that improve forums, and the ones that inform a Question and Answer functionality, as recently as a few days ago.

On a completely personal level I hate the fact that we had to reprioritize the Support area out of our work last year because of the mad scramble for tasks that supported D8 release - I was a habitual lurker/not-poster, especially in my own early Drupal days - but as the Project Manager for the DA I understand why we made that call. I'm really looking forward to being able to take that up again in some way this year. Incremental things like the follow notifications were hopefully just a very small start.

To @Jaypan's comment about throwing away the forums entirely - I think it became clear when vetting the 'move to stack exchange' proposal that the forums serve a purpose greater than the specific questions and answers that something like Drupal Answers serves. (A distinction that @Worldfallz rightfully drew in her proposals). I doubt the eventual 'Drupal support ecosystem' would remove the forums entirely at this point - but I do think it's brought some clarity to the distinction in the kind of support that is better served by Drupal Answers (specific technical questions with an answer that is universal for later viewers) and served by the forums (welcoming of newbies, helping people find their feet, more general advice about approaches vs. specific technical solutions). Both will clearly have their place and I think we understand that better than we did.

Figuring out what the right bite sized pieces are is the next step - and lets do that here: #2533804: Create 'Support' Section

--
Tim L
Drupal Association - CTO

dddave’s picture

I'd love to upvote this comment. ;)

Jaypan’s picture

I'd love to upvote this comment. ;)

Hopefully we'll have functionality like that if this all goes through!

Jaypan’s picture

Hestenet - thank you for your comments, and to be honest, they are the first comments I've heard so far that give me any hope whatsoever that improvements to the forums and community support on the DO may be coming.

I look forward to seeing how this proceeds. You can be assured I'll be vocal in the process whether it goes forward or not.

WorldFallz’s picture

I agree with Jay completely-- and let me also thank you for weighing in on this post!

Both will clearly have their place and I think we understand that better than we did.

Definitely music to my ears! However, it would be good to see that reflected in either/both of the 'petition' post in the forums or the main issue in the issue queue.

And I would feel remiss if I didn't point out that "Create 'Support' Section" made the list while "Improve the forums" did not.

It could be argued that since we already have the drupalanswers stackexchange for the Q&A format, creating our own support section is of less urgency then bringing the outdated forums even somewhat up-to-date-- especially considering how much less work it would be.

hestenet’s picture

We wanted to the larger issue to be in scope - but I think you're correct that some of the next decisions will about some more improvements on the forums side. (More detailed discussion should go in the issues, but...) In particular when looking at your original document: topic voting, marking 'best reply', and some moderation tools seem like the next steps. Looking at those things, I'm looking for the logical wins - things that could be architected based on what's already in place. For example, we already use Flag, so we'd want to take that route to implement things like voting and best reply. There are also some decisions to make philosophically, such as whether we want a simpler, and potentially more community friendly 'flag as helpful' as our upvote, or if a true up and down vote is preferable. (I'm agnostic, but they do project different attitudes onto the conversation). I'll hopefully be adding some child issues onto that main issue soon.

--
Tim L
Drupal Association - CTO

Jaypan’s picture

Well, it's been almost a year and a half since this issue was opened, and since then not a single improvement to the forums. They are just as 2005 as they were in 2005.

I've almost entirely switched over to providing support on Drupal Answers (drupal.stackexchange.com) myself. I still sometimes help people here, because I hate seeing people so desperately trying to get support and getting nothing, but the forum software here is so frustrating to work with. So I do help some posters occasionally. But basically I recommend anyone that wants any real support to give up on the Drupal forums, and head to Drupal Answers, as you are much more likely to be able to find what you need there. The Drupal association has shown that the forums are literally at the bottom of the priority list when it comes to the community.

dddave’s picture

I am not sure I want to comment more on this. :/

cosmicdreams’s picture

I tried clicking on the learn about volunteering button and was redirected back to this same page. A number of these initiatives sound very interesting and I am trying to gauge how much of a time commitment volunteering to help would be. I'd like to see if this is something I can participate in.

hestenet’s picture

Thanks for reporting the broken link - it is intended to take folks to this page: https://assoc.drupal.org/drupal.org-volunteer-proposal

Hopefully the information you're looking for is there, but feel free to reach out directly to me if you have questions: https://www.drupal.org/user/54034/contact

--
Tim L
Drupal Association - CTO

mr.ashishjain’s picture

Liam definitely has a point, however we need to consider things from broader perspective with changing times and technology advancements to not only survive but grow. Lets accept these changes for good, try contributing where we can as thats the beauty of this community, isn't it..!