Problem/Motivation
The current release window of Drupal security advisories falls on Wednesday evening after office hours for Europe and Asia. It falls during the day Wednesday in the Americas.
As such, assuming teams work only during office hours, for most of the world there is 2 days left in the week to apply the patch and push to production.
It is also common practice not to deploy on Fridays as if anything goes wrong, nobody is there to fix the issues on Saturday.
As such, the time to get ready and deploy is likely just a day for many teams, failing to meet that window, the patch will only make it to production the next week.
In changing times where Sec releases are more and more numerous, more and more frequent, and also have never been so easy to exploit thanks to AI, I believe moving the security release window earlier in the week would help many teams release security patch to production in 2-3 days instead of 4-5 days.
Indeed, for example, a team that needs 2 days to apply the patch, get approvals and go through UAT, having the security release on Tuesday evening by the community instead of Wednesday allows them to deploy on Thursday instead of the following week's Monday (if Friday is considered out). That 3 day difference could be very significant for security reasons.
Steps to reproduce
NA
Proposed resolution
The proposal is to bring the security window earlier in the week, ideally Monday, or else Tuesday, any additional days given before the weekend increasing the chances or more sites being patched before bad actors exploit the vulnerabilities, assuming good people have working hours and rest the weekend and bad actors may not.
Moreover, reduce the frequency of the windows to "every 2 weeks" instead of "every week"
Remaining tasks
Decide on any process changes that are needed.
Give appropriate advanced communications (at least a week, hopefully more) via multiple channels (psa, social, slack)
Enact the process changes (e.g. move the security release window to Tuesday, add more core release windows, etc.)
User interface changes
NA
API changes
Not sure
Data model changes
NA
Comments
Comment #2
aangel commentedIt seems to me that the tension is between the team preparing the releases and those who have to operate on them. I'm guessing that Wednesday was picked to give both groups equal time. Moreover, I'm also guessing (i.e. I don't know) that the Security Team wants to release as early as possible on Wednesday.
Since I never release on Friday (as tguilpain mentions), for me and other teams with Thursday releases the available time really is just:
Thus, the three ways forward I see are:
It looks to me that 2 and 4 are possibilities but this really needs DST members to chime in. I imagine that Wednesday might also have been picked so that there was Tuesday to prepare for the Wednesday release when there are long weekends.
And then there is Asia :-).
(I'm a consumer in North America and can make any of the above work.)
Comment #3
damienmckenna"Timezones, man!"
Comment #4
damienmckennaI'd like to refine this proposal slightly.
A few things stand out about this topic:
0. Due to the fact we don't all live on a flat earth, that we're on a planet that's rotating as it spins around the sun, we have timezones as a limitation we have to deal with. This unfortunately means that portions of the Drupal community are going to loose out as regards to when the releases are made. Given that the majority of Drupal sites are in the US, and the majority of members of the DST are in the US, we focus on US timezones.
1. We want to give people as much time to be able to complete the necessary regression testing and UAT prior to launch as they can, so people East of the US generally have to deal with the releases on their Thursday, instead of Wednesday like in the US.
2. The security team and project maintainers need time in order to complete their releases.
3. Due to the current AI firehose effect, the DST has been refining internal processes.
4. It is fairly common during the year for Mondays to be a holiday in different countries, it is far less common for Tuesday to be a holiday.
5. In a world of thousands of contrib modules and ~40 weeks during the year where contrib projects can be given a security release, it wouldn't be a terrible problem to postpone a release a single week.
I would like to propose the following:
1. Except in emergencies, the list of projects being released in a given week be finalized by EOD (Eastern US time) on the Friday before the release window; if a release isn't ready to go by the Friday then it gets pushed to the following release window.
2. The release window is moved from Wednesday to Tuesday.
3. We try to publish SAs as close to noon Eastern US time as possible; we already do try to, but adhering to item #1 might make it easier.
4. We could separately consider publishing them earlier, but I think this is a discussion worth separating from a decision on which day the releases happen on.
We could split this out into separate proposals to let this issue focus exclusively on the release day while the other ideas are pushed to other issues?
Comment #5
guptahemant commentedPlus 1 to the proposal, being in indian timezone, we generally get to know exactly on thursday about what's the actual impact, which gives very little time in the week to do production hotfixes, having the releases on Tuesday will be very much helpful.
Comment #6
samruddhi.ugave commented+1 for moving the window to Tuesday (or Monday).
As a Project Manager, Wednesday releases place significant pressure on scheduling. In European/Asian timezones, advisories drop late Wednesday, leaving effectively only Thursday to review the advisory, apply the patch, run UAT, and deploy.
Because we enforce a strict "No Deployments on Friday" policy to safeguard our team's weekends, any patch that cannot be fully vetted on Thursday gets pushed to the following week. This extends our exposure window unnecessarily.
Having the release window on Tuesday would give teams a realistic 2-day runway (Wednesday and Thursday) to properly test and ship security releases safely before the weekend.
Comment #7
the_g_bomb commentedOn the topic of time zones, it may be worth noting how they line up.
6am PST, 9am EST, 2pm UTC, 3pm CET, 7:30pm IST, 1am AEDT
9am PST, 12pm EST, 5pm UTC, 6pm CET, 10:30pm IST, 4am AEDT
12pm PST, 4pm EST, 9pm UTC, 10pm CET, 2:30am IST, 8am AEDT
IMHO, the current 12 pm EST suits the fewest regions in terms of office hours.
https://www.worldtimebuddy.com/?qm=1&lid=8,5,100,14,12,30,21&h=100&sln=1...
Comment #8
dimitriskr commentedI'd like to propose to change the scheduling of the security release windows too, as following
Contrib projects - Every 2 weeks
Core - Once per month
In order not to overlap, given a month has 4 weeks, core can be on 3rd week, as it is already, and contrib on 2nd and 4th.
This process as a great impact already to everyone involved, especially for the sec team which I can't imagine the levels. If this proposal increases the workload and stress of the sec team, I understand not going with this.
For the agencies, developers etc, having some sort of break and allowing more time to apply the security releases to their projects, can make it less stressful. I wouldn't mind updating 3-4 modules more every 2 weeks
Comment #9
prudloff commentedI think the day, frequency and time discussions should be separate to make this easier to discuss.
Comment #10
catchIt's unrealistic to reduce the frequency of contrib releases when the current volume is so high, it would mean having to release potentially more than 100 SAs on a single day. Regardless of how much preparation is done in advance, that would be unsustainable to do during a single window - unless we extend the window to the entire day or something but then there is effectively no defined window. Agreed with #9 that the discussion should be split.
Comment #11
kingdutchI'm mostly ambivalent/slightly against the proposal if only that it means that plannings and schedules that have now worked for years need to be uprooted.
The reason for the request ("it takes us a long time to deploy a security release") worries me though. With the advent of AI I do not think it's realistic to think that attackers are going to wait for internal business processes and approvals before they decide to start attacking with information from a published security release.
Perhaps it warrants a separate issue, because I don't want to derail this conversation, but I'm very curious what is preventing companies that use Drupal from rolling out security updates in hours rather than days? I realize a large part of it might be bureaucracy, but I think the "time to exploit" in the current world is rapidly going from "days/weeks" to "hours" regardless of the severity of the vulnerability. In the near future, being able to react to vulnerabilities within an hourly time-frame will become table-stakes for companies.
Rather than spending energy moving the release window by a day to support an arguably broken process, I'd love to see that energy invested instead in enabling Drupal teams to roll out security fixes more quickly. It could be a huge selling point for Drupal and any organization using it if we can ensure that everyone is able to respond to security releases quickly and safely using automation.
Comment #12
prudloff commentedRemember that the size of Drupal companies and the number of websites they manage varies a lot, from large teams managing a single platform to small agencies with dozens of clients.
The level of automation (CI/CD) probably also varies a lot.
As a small company that manages more 50 websites the proposed change would definitely give us room to breath. Even with automation it is hard to fit updating every website in a single work day.
Comment #13
catchThis is not really the case for a lot of core SAs though. We release SAs for a lot of things that are only exploitable with a specific contrib module installed, or only exploitable if someone is able to create/edit content on the site etc. when many sites don't have open registration or permissions to create content for untrusted users, they may only have one user in total.
This means that a site may well know that they're not vulnerable as such, and want to release the security release as part of a general deployment window, but also that they might not want to do that the week after the SA comes out.
Taking 'frequency' out of the title here, if people want to discuss the time of day and frequency of release windows, please open separate discussions and link them from here.
Comment #14
damienmckenna(shortening the issue title)
Comment #15
rhovlandSometimes security fixes remove mis-features or cause unavoidable BC breaks, especially in contrib. See the Entity API module for example. A security fix removed JSON:API access that wasn't supposed to be exposed. Anyone depending on that bad behavior suddenly had broken sites. The fix to restore it belonged to whatever module implemented the entity but not the Entity API module itself.
I'd also support moving to Tuesday for reasons such as that, even though I am under no time pressure.
Comment #16
venu.tallapragada commentedI recommend moving the release window to Tuesday (or Monday).
From a project management standpoint, the current Wednesday schedule creates severe operational bottlenecks for distributed teams. When advisories drop late Wednesday in European and Asian timezones, Wednesday is effectively lost. This leaves Thursday as the sole working day to review the advisory, apply the patch, run UAT, and deploy.
The current 12:00 PM EST release window suits the fewest regions during active business hours.
Because the current slot hits at the end of the workday in Europe, late night in India, and the early morning hours in APAC, immediate remediation simply cannot happen during normal shift hours.
Compounding this, many organizations including ours enforce a strict "No Deployments on Friday" policy to safeguard production stability and team weekends. If a patch cannot be comprehensively tested and cleared during Thursday's narrow window, it gets deferred to the following week. This rolls our exposure window over the weekend for an unnecessary extra 3 to 4 days.
Shifting the release to Tuesday (and ideally targeting an earlier slot like 9:00 AM EST) provides a realistic two-day runway across Wednesday and Thursday. That gives global teams the space to thoroughly vet, test, and ship security updates safely without forcing late-night scrambles or extending vulnerability windows over the weekend.
Comment #17
fwust+1 for Tuesday (or monday).
On #11: we automate as much as we can, but as an agency running many client sites, part of the delay is client-side validation we don't control. Having Wednesday and Thursday instead of just Thursday makes a real difference there.
Comment #18
guicom commented+1 for Tuesday.
Comment #19
mιχaliς commented+1 for Tuesday or Monday too
Comment #20
aabaou commented+1 for Tuesday too
Comment #21
prudloff commentedI think it has been established that this would be useful for some companies.
Commenting +1 now just adds noise.
Comment #22
nono95230 commented+1 for Tuesday too
Comment #23
damienmckennaWe have a lot of people in agreement with changing the day to Tuesday. Is there anyone who believes it should stay as-is on Wednesday?
Comment #24
gregglesThere were significant conerns from Security Team members of whether this would allow enough time to get releases prepped.
I think we should wait a bit longer for those thoughts to percolate and evolve before making any kind of decision, and work on other areas of process improvement before considering this change.
Comment #25
catchFor me the main barrier to moving this to Tuesday, is that there are often public holidays on Mondays.
So for core, I would want two usable windows per month, so that there when there is a public holiday just before a window, we can definitely use the other window without having to release a PSA for an off-schedule security release.
This would help if we need to e.g. do a co-ordinated release with an upstream dependency too.
Then contrib releases could continue to happen on core windows that aren't used by core (or possibly alongside core releases but we usually avoid that to simplify things for site owners).
Comment #26
damienmckennaI think that other policy adjustments should be taken into consideration to make handling this easier, but those are separate topics.
(a key proposal would be to have everything ready the Friday before the release, so that we (DST and project maintainers) know the week before whether something is going out, rather than often deciding the literal day before or even morning of release)
Comment #27
feyp commentedWe're not opposed to the proposal, I think for our situation it would actually be a better fit than the existing window. I just wanted to mention that due to the fact that both the existing and the proposed window will be outside our regular office hours, for us it would be important that any change would be communicated well in advance. It won't be a problem to adapt our processes, but at least in some cases people might have to reschedule long-term private commitments so that they can be on stand-by. For some, it would also affect the schedules of family members. So an announcement at least a few months in advance would be appreciated.
Comment #28
damienmckennaAbsolutely.
Comment #29
gregglesYes, I added some to the implementation plan to cover this would be communicated well in advance of any change.