Update aborted by system_post_update_sort_all_config. Drush command terminated abnormally. Output is empty.

Where is Drush installed and what version is it?

Hi. How is it installed, precisely? Why are you using a release candidate version?

I am having a similar problem with the the "sort_all_config" post-update script. I am getting an out of memory error. The error message I get when running drush updatedb is:

mmap() failed: [12] Cannot allocate memory
PHP Fatal error:  Out of memory (allocated 2947022848) (tried to allocate 262144 bytes) in /home/xxx/xxx/web/core/lib/Drupal/Core/Config/TypedConfigManager.php on line 200

I tried increasing the RAM on the server and just got a similar error.

I am running Composer v2.1.14 and drush status gives:

 Drupal version   : 9.3.0
 Site URI         : http://default
 DB driver        : mysql
 DB hostname      : localhost
 DB port          : 3306
 DB username      : xxx
 DB name          : xxx_drupal
 Database         : Connected
 Drupal bootstrap : Successful
 Default theme    : xxx
 Admin theme      : gin
 PHP binary       : /usr/bin/php7.4
 PHP config       : /etc/php/7.4/cli/php.ini
 PHP OS           : Linux
 Drush script     : /home/xxx/xxx/vendor/drush/drush/drush
 Drush version    : 10.6.1
 Drush temp       : /tmp
 Drush configs    : /home/xxx/xxx/vendor/drush/drush/drush.yml
 Install profile  : standard
 Drupal root      : /home/xxx/xxx/web
 Site path        : sites/default
 Files, Public    : sites/default/files
 Files, Temp      : /tmp

I'm from the other thread but my error and situation is the exact same as teddyvermeulin's.

>  [notice] Update started: system_post_update_sort_all_config
>  [warning] Drush command terminated abnormally.

In ProcessBase.php line 155:

  Output is empty.

Composer version 2.1.14, Drush status

 Drupal version   : 9.3.0                                                
 Site URI         : http://default                                       
 DB driver        : mysql                                                
 DB hostname      : localhost                                            
 DB port          : 3306                                                 
 DB username      : xxx                       
 DB name          : xxx
 Database         : Connected                                            
 Drupal bootstrap : Successful                                           
 Default theme    : xxx_rtheme                                        
 Admin theme      : claro                                                
 PHP binary       : /opt/cpanel/ea-php74/root/usr/bin/php                
 PHP config       : /opt/cpanel/ea-php74/root/etc/php.ini                
 PHP OS           : Linux                                                
 Drush script     : /usr/local/bin/drush                                 
 Drush version    : 10.6.1                                               
 Drush temp       : /tmp                                                 
 Drush configs    : /home/xxx/public_html/vendor/drush/drush/drush.yml 
 Install profile  : minimal                                              
 Drupal root      : /home/xxx/public_html/web                          
 Site path        : sites/default                                        
 Files, Public    : sites/default/files                                  
 Files, Temp      : /tmp 

The class with the error is reporting that a process execution returned nothing. It's from a library that Drush uses. I am not sure we can help you here.

Even if Drupal Core is the root cause of this issue you are going to have to do some debugging of that execution point to figure out what is going on, or, seek some debugging assistance in the Drush issue queue. There is just not enough to go on here. No one has even mentioned whether anything was logged, nor offered a stack trace.

@bmango Running out of memory is not, prima facie, the same issue.

One more thing: It would be interesting to see what update.php does.

I tried update.php. It gave the error "An unrecoverable error has occurred" with "An AJAX HTTP error occurred" after it.

The web server and site logs did not record this event?

I do remember checking my logs right after but I don't recall anything notable or stored any of those logs, unfortunately.

Something I did store was this particular error, hopefully it's useful.

ArgumentCountError: Too few arguments to function Drush\Drupal\Commands\core\DrupalCommands::__construct(), 2 passed in /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php on line 262 and exactly 3 expected in Drush\Drupal\Commands\core\DrupalCommands->__construct() (line 60 of /home/xxx/public_html/vendor/drush/drush/src/Drupal/Commands/core/DrupalCommands.php)

#0 /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php(262): Drush\Drupal\Commands\core\DrupalCommands->__construct(Object(Drupal\Core\ProxyClass\Cron), Object(Drupal\Core\Extension\ModuleHandler))
#1 /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php(176): Drupal\Component\DependencyInjection\Container->createService(Array, 'drupal.commands')
#2 /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php(437): Drupal\Component\DependencyInjection\Container->get('drupal.commands', 1)
#3 /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php(276): Drupal\Component\DependencyInjection\Container->resolveServicesAndParameters(Array)
#4 /home/xxx/public_html/web/core/lib/Drupal/Component/DependencyInjection/Container.php(176): Drupal\Component\DependencyInjection\Container->createService(Array, 'drush.command.s...')
#5 /home/xxx/public_html/vendor/drush/drush/src/Boot/DrupalBoot8.php(280): Drupal\Component\DependencyInjection\Container->get('drush.command.s...')
#6 /home/xxx/public_html/vendor/drush/drush/src/Boot/DrupalBoot8.php(246): Drush\Boot\DrupalBoot8->addDrupalModuleDrushCommands(Object(Drush\Boot\BootstrapManager))
#7 /home/xxx/public_html/vendor/drush/drush/src/Boot/BootstrapManager.php(293): Drush\Boot\DrupalBoot8->bootstrapDrupalFull(Object(Drush\Boot\BootstrapManager), NULL)
#8 /home/xxx/public_html/vendor/drush/drush/src/Boot/BootstrapManager.php(493): Drush\Boot\BootstrapManager->doBootstrap(5, 6, NULL)
#9 /home/xxx/public_html/vendor/drush/drush/src/Boot/BootstrapManager.php(427): Drush\Boot\BootstrapManager->bootstrapMax(6)
#10 /home/xxx/public_html/vendor/drush/drush/src/Boot/BootstrapManager.php(396): Drush\Boot\BootstrapManager->bootstrapToPhaseIndex(-2, Object(Consolidation\AnnotatedCommand\AnnotationData))
#11 /home/xxx/public_html/vendor/drush/drush/src/Boot/BootstrapHook.php(28): Drush\Boot\BootstrapManager->bootstrapToPhase('max', Object(Consolidation\AnnotatedCommand\AnnotationData))
#12 /home/xxx/public_html/vendor/consolidation/annotated-command/src/Hooks/Dispatchers/InitializeHookDispatcher.php(44): Drush\Boot\BootstrapHook->initialize(Object(Drush\Symfony\DrushArgvInput), Object(Consolidation\AnnotatedCommand\AnnotationData))
#13 /home/xxx/public_html/vendor/consolidation/annotated-command/src/Hooks/Dispatchers/InitializeHookDispatcher.php(36): Consolidation\AnnotatedCommand\Hooks\Dispatchers\InitializeHookDispatcher->doInitializeHook(Object(Drush\Boot\BootstrapHook), Object(Drush\Symfony\DrushArgvInput), Object(Consolidation\AnnotatedCommand\AnnotationData))
#14 /home/xxx/public_html/vendor/consolidation/annotated-command/src/Hooks/Dispatchers/InitializeHookDispatcher.php(29): Consolidation\AnnotatedCommand\Hooks\Dispatchers\InitializeHookDispatcher->callInitializeHook(Object(Drush\Boot\BootstrapHook), Object(Drush\Symfony\DrushArgvInput), Object(Consolidation\AnnotatedCommand\AnnotationData))
#15 /home/xxx/public_html/vendor/consolidation/annotated-command/src/CommandProcessor.php(145): Consolidation\AnnotatedCommand\Hooks\Dispatchers\InitializeHookDispatcher->initialize(Object(Drush\Symfony\DrushArgvInput), Object(Consolidation\AnnotatedCommand\AnnotationData))
#16 /home/xxx/public_html/vendor/consolidation/annotated-command/src/AnnotatedCommand.php(296): Consolidation\AnnotatedCommand\CommandProcessor->initializeHook(Object(Drush\Symfony\DrushArgvInput), Array, Object(Consolidation\AnnotatedCommand\AnnotationData))
#17 /home/xxx/public_html/vendor/symfony/console/Command/Command.php(221): Consolidation\AnnotatedCommand\AnnotatedCommand->initialize(Object(Drush\Symfony\DrushArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#18 /home/xxx/public_html/vendor/symfony/console/Application.php(1027): Symfony\Component\Console\Command\Command->run(Object(Drush\Symfony\DrushArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#19 /home/xxx/public_html/vendor/symfony/console/Application.php(273): Symfony\Component\Console\Application->doRunCommand(Object(Consolidation\AnnotatedCommand\AnnotatedCommand), Object(Drush\Symfony\DrushArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#20 /home/xxx/public_html/vendor/symfony/console/Application.php(149): Symfony\Component\Console\Application->doRun(Object(Drush\Symfony\DrushArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#21 /home/xxx/public_html/vendor/drush/drush/src/Runtime/Runtime.php(118): Symfony\Component\Console\Application->run(Object(Drush\Symfony\DrushArgvInput), Object(Symfony\Component\Console\Output\ConsoleOutput))
#22 /home/xxx/public_html/vendor/drush/drush/src/Runtime/Runtime.php(48): Drush\Runtime\Runtime->doRun(Array, Object(Symfony\Component\Console\Output\ConsoleOutput))
#23 /home/xxx/public_html/vendor/drush/drush/drush.php(72): Drush\Runtime\Runtime->run(Array)
#24 /home/xxx/public_html/vendor/drush/drush/includes/preflight.inc(18): require('/home/xxx/pub...')
#25 phar:///usr/local/bin/drush/bin/drush.php(141): drush_main()
#26 /usr/local/bin/drush(10): require('phar:///usr/loc...')
#27 {main}

Looks like this is an issue that popped up as a result of this commit: https://git.drupalcode.org/project/drupal/-/commit/e40f6d17d6087e75faafd...

A function to sort config (system_post_update_sort_all_config()) was added thats causing issues when upgrading from Drupal 9.2.x to 9.3.0.

Im getting the same errors locally and it preventing me from upgrading. Not sure what the best solution is yet.

A stack trace from the crash would be helpful, whether it comes via update.php or Drush. I am not sure the one in #12 is related as it seems to be from the Drush bootstrap process and it doesn't mention system_post_update_sort_all_config() at all - if the crash was there I would expect it in the trace.

For Drush users running with drush -d might give extra clues in the debug output.

For what it's worth I've successfully upgraded two sites to 9.3.0 via drush and have not seen this error.

I'm also having an out of memory error when getting to system_post_update_sort_all_config().

>  [notice] Update started: system_post_update_sort_all_config [5.36 sec, 22.26 MB]
> PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /var/www/html/docroot/core/lib/Drupal/Core/Config/TypedConfigManager.php on line 189
>  [warning] Drush command terminated abnormally. [37.07 sec, 115.67 MB]

In ProcessBase.php line 171:
                                                                                                                   
  [InvalidArgumentException]                                                                                       
  Unable to decode output into JSON: Syntax error                                                                  
                                                                                                                   
  Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 20480 bytes) in /var/www/html/  
  docroot/core/lib/Drupal/Core/Config/TypedConfigManager.php on line 189                                           
                                                                                                                   

Exception trace:
  at /var/www/html/vendor/consolidation/site-process/src/ProcessBase.php:171
 Consolidation\SiteProcess\ProcessBase->getOutputAsJson() at /var/www/html/vendor/drush/drush/includes/batch.inc:155
 _drush_backend_batch_process() at /var/www/html/vendor/drush/drush/includes/batch.inc:80
 drush_backend_batch_process() at /var/www/html/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:465
 Drush\Commands\core\UpdateDBCommands->updateBatch() at /var/www/html/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:76
 Drush\Commands\core\UpdateDBCommands->updatedb() at n/a:n/a
 call_user_func_array() at /var/www/html/vendor/consolidation/annotated-command/src/CommandProcessor.php:257
 Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback() at /var/www/html/vendor/consolidation/annotated-command/src/CommandProcessor.php:212
 Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter() at /var/www/html/vendor/consolidation/annotated-command/src/CommandProcessor.php:176
 Consolidation\AnnotatedCommand\CommandProcessor->process() at /var/www/html/vendor/consolidation/annotated-command/src/AnnotatedCommand.php:313
 Consolidation\AnnotatedCommand\AnnotatedCommand->execute() at /var/www/html/vendor/symfony/console/Command/Command.php:255
 Symfony\Component\Console\Command\Command->run() at /var/www/html/vendor/symfony/console/Application.php:1027
 Symfony\Component\Console\Application->doRunCommand() at /var/www/html/vendor/symfony/console/Application.php:273
 Symfony\Component\Console\Application->doRun() at /var/www/html/vendor/symfony/console/Application.php:149
 Symfony\Component\Console\Application->run() at /var/www/html/vendor/drush/drush/src/Runtime/Runtime.php:118
 Drush\Runtime\Runtime->doRun() at /var/www/html/vendor/drush/drush/src/Runtime/Runtime.php:49
 Drush\Runtime\Runtime->run() at /var/www/html/vendor/drush/drush/drush.php:72
 require() at /var/www/html/vendor/drush/drush/drush:4

updatedb [--cache-clear [CACHE-CLEAR]] [--entity-updates] [--post-updates [POST-UPDATES]] [--no-cache-clear] [--no-post-updates] [-h|--help] [-q|--quiet] [-v|vv|vvv|--verbose] [-V|--version] [--ansi] [--no-ansi] [-n|--no-interaction] [-d|--debug] [-y|--yes] [--no] [--remote-host REMOTE-HOST] [--remote-user REMOTE-USER] [-r|--root ROOT] [-l|--uri URI] [--simulate] [--pipe] [-D|--define DEFINE] [--notify [NOTIFY]] [--druplicon] [--xh-link XH-LINK] [--] <command>

Failed to run drush updb -d: exit status 1

This is a bug. For installations with a large number of configuration files, system_post_update_sort_all_config() cannot process them all without running out of memory. Patch forthcoming to convert this function to a batch process.

I think this issue is now tracking two separate ones and should be split:

One is the out of memory problem. The other is "output is empty".

I believe the memory exhaustion needs its own issue. Please create one.

I think drush runs some work in subprocesses? If the subprocess crashes with out of memory that could be "no output" in some situations/configurations?

I've created https://www.drupal.org/project/drupal/issues/3254403#comment-14339216 and provided a patch there. The patch fixes it for me.

Thanks. If I’m wrong I’m wrong.

If someone who is experiencing this issue can test @paulmckibben's patch in the other issue and report if it works for them (or not) that would help to get this fixed for everyone.

I've ran the patch supplied by @paulmckibben, and im still getting the "output is empty" error. The patch supplied is a different issue - as @cilefen said.

Debugging it a bit more, it looks like my particular issue is related to a custom theme settings file. I suspect other people running into this issue also has a few janky config files that are being highlighted by the new post-update function. That being said, it could use better error handling to make it a bit more robust, but that might be out of scope for this particular issue.

I tried the patch 3254403-7.patch from system_post_update_sort_all_config can exhaust PHP memory in 9.3.0, and the patch did not work for me. Although I was getting an out of memory error, I realised I was also then getting the Output is empty error in ProcessBase.php line 155.

I then ran drush updatedb -vvv and got the following exception trace:

Exception trace:
  at /home/xxx/xxx/vendor/consolidation/site-process/src/ProcessBase.php:155
 Consolidation\SiteProcess\ProcessBase->getOutputAsJson() at /home/xxx/xxx/vendor/drush/drush/includes/batch.inc:157
 _drush_backend_batch_process() at /home/xxx/xxx/vendor/drush/drush/includes/batch.inc:80
 drush_backend_batch_process() at /home/xxx/xxx/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:472
 Drush\Commands\core\UpdateDBCommands->updateBatch() at /home/xxx/xxx/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:83
 Drush\Commands\core\UpdateDBCommands->updatedb() at n/a:n/a
 call_user_func_array() at /home/xxx/xxx/vendor/consolidation/annotated-command/src/CommandProcessor.php:257
 Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback() at /home/xxx/xxx/vendor/consolidation/annotated-command/src/CommandProcessor.php:212
 Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter() at /home/xxx/xxx/vendor/consolidation/annotated-command/src/CommandProcessor.php:176
 Consolidation\AnnotatedCommand\CommandProcessor->process() at /home/xxx/xxx/vendor/consolidation/annotated-command/src/AnnotatedCommand.php:313
 Consolidation\AnnotatedCommand\AnnotatedCommand->execute() at /home/xxx/xxx/vendor/symfony/console/Command/Command.php:255
 Symfony\Component\Console\Command\Command->run() at /home/xxx/xxx/vendor/symfony/console/Application.php:1027
 Symfony\Component\Console\Application->doRunCommand() at /home/xxx/xxx/vendor/symfony/console/Application.php:273
 Symfony\Component\Console\Application->doRun() at /home/xxx/xxx/vendor/symfony/console/Application.php:149
 Symfony\Component\Console\Application->run() at /home/xxx/xxx/vendor/drush/drush/src/Runtime/Runtime.php:118
 Drush\Runtime\Runtime->doRun() at /home/xxx/xxx/vendor/drush/drush/src/Runtime/Runtime.php:48
 Drush\Runtime\Runtime->run() at /home/xxx/xxx/vendor/drush/drush/drush.php:72
 require() at /home/xxx/xxx/vendor/drush/drush/drush:4

Hope this helps.

It does not. That is almost all inside Drush. Perhaps ask at https://github.com/drush-ops/drush/issues and reference this issue.

Anyone affected: you must try with update.php and post the logged event.

I tried with update.php. I got the following error:

An AJAX HTTP error occurred.
HTTP Result Code: 500
Debugging information follows.
Path: /update.php/start?id=12&op=do_nojs&op=do
StatusText: Internal Server Error
ResponseText: 

In the error log the following was recorded:

Notice: Undefined offset: 1 in Drupal\system\Controller\DbUpdateController->results() (line 423 of /home/xxx/xxx/web/core/modules/system/src/Controller/DbUpdateController.php)
#0 /home/xxx/xxx/web/core/includes/bootstrap.inc(346): _drupal_error_handler_real()
#1 /home/xxx/xxx/web/core/modules/system/src/Controller/DbUpdateController.php(423): _drupal_error_handler()
#2 /home/xxx/xxx/web/core/modules/system/src/Controller/DbUpdateController.php(179): Drupal\system\Controller\DbUpdateController->results()
#3 [internal function]: Drupal\system\Controller\DbUpdateController->handle()
#4 /home/xxx/xxx/web/core/lib/Drupal/Core/Update/UpdateKernel.php(115): call_user_func_array()
#5 /home/xxx/xxx/web/core/lib/Drupal/Core/Update/UpdateKernel.php(76): Drupal\Core\Update\UpdateKernel->handleRaw()
#6 /home/xxx/xxx/web/update.php(27): Drupal\Core\Update\UpdateKernel->handle()
#7 {main}

(referrer: https://mydomain.org.uk/update.php/start?id=12&op=start)

Corrected spelling error in issue title

The trace in #28 looks like a separate bug in update.php.

Line 423 is

      [$module, $version] = array_pop($last);

$last is the last operation in updates_remaining, which is the set of remaining operations.

For hook_update_N this is OK:

        $batch_builder->addOperation('update_do_one', [$update['module'], $update['number'], $dependency_map[$function]]);

For post_update hooks the array only contains one item:

        $batch_builder->addOperation('update_invoke_post_update', [$function]);

#2935012: DbUpdateController abort message does not work for post updates looks to report the same problem.

@bmango is there anything else recorded in your web server error log or elsewhere? A PHP notice should not be enough to trigger 500 Internal Server Error.

@longwave - there is nothing recorded in the syslog. In the apache error log, I only have:

[php7:error] [pid 16644] [client xx.27.58.xx:8592] PHP Fatal error: Allowed memory size of 1073741824 bytes exhausted (tried to allocate 262144 bytes) in Unknown on line 0, referer: https://mydomain.org.uk/update.php/start?id=12&op=start

I don't have xdebug installed on this server. But if there is another way I can generate a backtrace, please let me know.

@bmango so to confirm you still got out of memory even with #3254403: system_post_update_sort_all_config can exhaust PHP memory in 9.3.0 because processing is not batched applied? 1073741824 is 1Gb so in theory this should be plenty :/

@longwave - yes, correct, I have applied the patch from #3254403: system_post_update_sort_all_config can exhaust PHP memory in 9.3.0, and I am still getting out of memory. I also flushed caches.

@bmango - I'm curious if reducing the batch iteration size might help you? Assuming the patch from #3254403 is still applied for you, in core/modules/system/system.post_update.php, around line 213, try changing:

$iteration_size = \Drupal\Core\Site\Settings::get('entity_update_batch_size', 50);

to

$iteration_size = 10;

Or even less if that doesn't work.

If reducing the iteration size solves your problem, we can update the patch accordingly. If reducing it does not solve your problem, then perhaps in your case, the memory issue might be elsewhere. Thanks!

@paulmckibben, I tried reducing the batch iteration size and it made no difference, even $iteration_size = 1; didn't work.

I guess my memory issue must be elsewhere.

In my case, I solved this issue by uninstalling additional themes I had installed (Barrio, a custom Barrio sub-theme, Olivero and Seven). I am guessing it was probably the Barrio/Barrio sub-theme that was causing the problem.

Removing the additional custom themes allowed the update to run without any errors.

mmm... I just checked my config table and I have about 9 theme entries that were installed during Drupal 7 but is still around in the database. Is this something that would break the update?

Name: ninesixtyrobots.settings
Data: a:3:{s:8:"features";a:5:{s:4:"name";i:0;s:6:"slogan";i:0;s:17:"node_user_picture";i:1;s:20:"comment_user_picture";i:1;s:7:"favicon";i:1;}s:4:"logo";a:2:{s:11:"use_default";i:1;s:4:"path";s:10:"site.png";}s:7:"favicon";a:2:{s:11:"use_default";i:1;s:4:"path";s:0:"";}}

Name: rootcandy.settings
Data: a:3:{s:8:"features";a:5:{s:4:"name";i:1;s:6:"slogan";i:0;s:17:"node_user_picture";i:1;s:20:"comment_user_picture";i:1;s:7:"favicon";i:1;}s:4:"logo";a:2:{s:11:"use_default";i:0;s:4:"path";s:0:"";}s:7:"favicon";a:2:{s:11:"use_default";i:1;s:4:"path";s:0:"";}}

Name: sky.settings
Data: a:3:{s:8:"features";a:6:{s:4:"name";i:0;s:6:"slogan";i:0;s:17:"node_user_picture";i:1;s:20:"comment_user_picture";i:1;s:25:"comment_user_verification";i:1;s:7:"favicon";i:0;}s:4:"logo";a:2:{s:11:"use_default";i:0;s:4:"path";s:10:"site.png";}s:7:"favicon";a:2:{s:11:"use_default";i:0;s:4:"path";s:0:"";}}

Name: tarski.settings
Data: a:2:{s:8:"features";a:5:{s:4:"name";i:0;s:6:"slogan";i:0;s:17:"node_user_picture";i:0;s:20:"comment_user_picture";i:1;s:7:"favicon";i:1;}s:7:"favicon";a:3:{s:11:"use_default";i:0;s:4:"path";s:11:"favicon.ico";s:8:"mimetype";s:24:"image/vnd.microsoft.icon";}}

I've removed them directly from the database, but I'm in a predicament where I've commented out the code in system_post_update_sort_all_config() and ran drush updatedb so that it could skip this update and finish the rest of the post updates to get the site back to working.

Is there anyway to run system_post_update_sort_all_config() again via drush or any other way? Is there a config I can change in the db to mark sort_all_config as incomplete and run drush updatedb again? Would like to see if removing those old themes will make this update work for me.

I have this issue. update.php didn't work either.

@chike Does it run out of memory with the diff from #3254403: system_post_update_sort_all_config can exhaust PHP memory in 9.3.0 because processing is not batched applied?

when i set the memory_limit to 2G ini_set('memory_limit', '2G');, i get this error running drush updb:

"Unable to decode output into JSON: Syntax error

Fatal error: Allowed memory size of 3221225472 bytes exhausted (tried to allocate 134217736 bytes) in /app/web/modules/contrib/purge/src/Plugin
/Purge/Queue/TxBuffer.php on line 171"

But if i set the memory_limit to -1 ini_set('memory_limit', '-1');,

I get the "Output is empty."

Patch from https://www.drupal.org/project/drupal/issues/3254403 is applied.

How low have you set entity_update_batch_size to troubleshoot?

Does anyone with a site that can reproduce this one despite the #3254403: system_post_update_sort_all_config can exhaust PHP memory in 9.3.0 because processing is not batched patch have the tools and knowledge to perform a formal memory analysis? That would help sort this out.

with this memory_limit in settings.php
# allow drush and php-cli to use a maximum of 3G memory
if (PHP_SAPI === 'cli') {
ini_set('memory_limit', '3G');
}

and tried with entity_update_batch_size = 5 and entity_update_batch_size = 1

it still got a timeout message during system_post_update_sort_all_config update.

> [notice] Update started: imagemagick_update_8304
> [notice] Update completed: imagemagick_update_8304
> [notice] Update started: user_update_9301
> [notice] Update completed: user_update_9301
> [notice] Update started: block_post_update_replace_node_type_condition
> [notice] Update completed: block_post_update_replace_node_type_condition
> [notice] Update started: node_post_update_rebuild_node_revision_routes
> [notice] Update completed: node_post_update_rebuild_node_revision_routes
> [notice] Update started: system_post_update_delete_authorize_settings
> [notice] Update completed: system_post_update_delete_authorize_settings
> [notice] Update started: system_post_update_sort_all_config
> [notice] Batch process has consumed in excess of 60% of available memory. Starting new thread
> [notice] Batch process has consumed in excess of 60% of available memory. Starting new thread
> PHP Fatal error: Allowed memory size of 3221225472 bytes exhausted (tried to allocate 61440 bytes) in /app/web/core/lib/Drupal/Core/Database/Driver/mysql/Insert.php on line 60
[success] Finished performing updates.

If i comment this update out, drush updb finishes successfully.

UPDATE: in my case, with purge module uninstalled, update works. Even though I have cleared purge before the update.

That is very interesting. Possibly this is Drupal\purge\Plugin\Purge\Queuer\QueuersService::reload.

i have tested on the same DB with uninstalling purge and installing it back and updb ran without any issues.
The update even worked without the patch with the batching

I got the way to run the update in my case bario theme causing the issue. So I took the below steps.

1. Exported all the configs
2. Uninstalled Bario and subthemes
3. Run database update
4. Imported all the configs

This patch might help sites that are hitting problems with the sort_all_config update failing, it outputs the name of each config item before it's processed, so you can at least track down which config file is faulty.

Also had Bario and a bario sub theme installed. #48 worked for me.

I've added another patch that also fixes https://www.drupal.org/project/drupal/issues/3254446 and improves the current code.
Was inspired by DamienMcKenna. Realised after using his patch that there are empty elements that break the update. Now those ones at least are rulled out.

Hello,

I have another issue with "Update aborted by system_post_update_sort_all_config".
I already posted a report a week ago here: https://www.drupal.org/project/draggableviews/issues/3260082

I try to update from 9.2.9 to 9.3.3
draggableviews 2.0.2-rc1
-> composer update works fine.

->drush updb stops with:
"Unable to decode output into JSON: Syntax error
Error: Call to a member function claimItem() on null in _drush_batch_worker() (line 244 of /www/htdocs/.../vendor/drush/drush/includes/batch.inc)."

-> update.php stops after some steps with:
"InvalidArgumentException: The configuration property display.default.display_options.fields.draggableviews.selected_actions.0 doesn't exist. in Drupal\Core\Config\Schema\ArrayElement->get() (Zeile 76 in /www/htdocs/.../web/core/lib/Drupal/Core/Config/Schema/ArrayElement.php)."

If I comment out all function code in system_post_update_sort_all_config :
drush updb still stops but update.php works fine.

What does system_post_update_sort_all_config do?
Is it important for the Drupal installation?

Any help and hint is appreciated.

[edit 2022-02-05]
I'm very sorry. It was my fault that the update routine stopped.
I had an old, deactivated view for draggableviews with mistakes in it.
After deleting the view everything went fine.
Thanks and sorry again.

Adding this in case it is useful to the discussion or someone else. I had this error caused by running the system_post_update_sort_all_config update after upgrading from 9.2.7 to 9.3.3:

The configuration property settings.plugins.language.language_list doesn't exist.

My configuration is a multisite with 3 sites. 2 sites upgraded fine but 1 failed. The configuration setting was part of the default settings in the Gutenberg module. As a temporary work around I uninstalled the module, ran the updates successfully, and then installed the module again.

I'm unsure at this point if I'll have an issue again the next time I run updates but at least the site is patched now.

[UPDATE 2022-02-09]
9.3.4 & 9.3.5 contained a number of bug fixes so I attempted to update from 9.3.3 to 9.3.5 with no recurring issues.

I decided to roll back to 9.2.7 and apply updates again upgrading to 9.3.5 but the same issue occurred. I investigated further and was able to simply remove the plugins.language.language_list from the editor.editor.*.yml config files, do a config sync import, and then run the pending updates. This succeeded with no issues at all.

Original config code

settings:
  plugins:
    language:
      language_list: un

Adjustment before manual config sync:

settings:
  plugins: {  }

Some of the yml files did contain other plugin settings so they did look slightly different after the adjustment.

#48 worked for me as well Bario was the culprit.

#48 also worked for me.
Thank you abhishek.kumar

I've been watching this issue for a while but, now that 9.2.x is no longer supported and the current patches aren't working for us, I thought I should share what I'm seeing.

I've tried both patches but still get the "Output is Empty" when trying to update the database when upgrading to 9.3.16. We're running Drush 11.0.9, Composer 2.3.5, Bario is not installed on our site and Purge is not installed on either dev instance. We have a custom theme built on the Zurb Foundation but uninstalling and deleting both (leaving only Bartik and Seven installed) does not prevent the issue.

Output of local "drush status":
Drupal version : 9.3.16
Site URI : https://DOMAINREMOVED.cloud
DB driver : mysql
DB hostname : localhost
DB port : 3306
DB username : drupal
DB name : drupal
Database : Connected
Drupal bootstrap : Successful
Default theme : regis
Admin theme : seven
PHP binary : /usr/local/php8.0/bin/php
PHP config : /usr/local/php8.0/etc/cli/php.ini
PHP OS : Linux
Drush script : /home/ide/project/vendor/bin/drush
Drush version : 11.0.9
Drush temp : /tmp
Drush configs : /home/ide/.drush/drush.yml
/home/ide/project/vendor/drush/drush/drush.yml
Install profile : standard
Drupal root : /home/ide/project/docroot
Site path : sites/default
Files, Public : sites/default/files
Files, Private : /mnt/files/regis.ide/sites/default/files-private
Files, Temp : /mnt/tmp/regis.ide

Output of local "drush updb -d -y" with the patch #51 applied:
Using the Drush script found at /home/ide/project/vendor/bin/drush using pcntl_exec
[preflight] Config paths: /home/ide/.drush/drush.yml,/home/ide/project/vendor/drush/drush/drush.yml
[preflight] Alias paths: /home/ide/project/docroot/drush/sites,/home/ide/project/drush/sites
[preflight] Commandfile search paths: /home/ide/project/vendor/drush/drush/src,/home/ide/project/docroot/drush,/home/ide/project/drush
[info] Starting bootstrap to full [0.18 sec, 8.92 MB]
[info] Drush bootstrap phase 5 [0.18 sec, 8.92 MB]
[info] Try to validate bootstrap phase 5 [0.18 sec, 8.92 MB]
[info] Try to validate bootstrap phase 5 [0.18 sec, 8.92 MB]
[info] Try to bootstrap at phase 5 [0.18 sec, 8.92 MB]
[info] Drush bootstrap phase: bootstrapDrupalRoot() [0.18 sec, 8.92 MB]
[info] Change working directory to /home/ide/project/docroot [0.18 sec, 8.92 MB]
[info] Initialized Drupal 9.3.16 root directory at /home/ide/project/docroot [0.18 sec, 8.92 MB]
[info] Try to validate bootstrap phase 5 [0.18 sec, 8.92 MB]
[info] Try to bootstrap at phase 5 [0.18 sec, 8.94 MB]
[info] Drush bootstrap phase: bootstrapDrupalSite() [0.18 sec, 8.94 MB]
[debug] Could not find a Drush config file at sites/default/drush.yml. [0.18 sec, 9.16 MB]
[info] Initialized Drupal site DOMAINREMOVED.cloud at sites/default [0.18 sec, 9.16 MB]
[info] Try to validate bootstrap phase 5 [0.18 sec, 9.16 MB]
[info] Try to bootstrap at phase 5 [0.18 sec, 9.16 MB]
[info] Drush bootstrap phase: bootstrapDrupalConfiguration() [0.18 sec, 9.16 MB]
[debug] Add service modifier [0.19 sec, 9.37 MB]
[info] Try to validate bootstrap phase 5 [0.19 sec, 9.37 MB]
[info] Try to bootstrap at phase 5 [0.19 sec, 9.95 MB]
[info] Drush bootstrap phase: bootstrapDrupalDatabase() [0.19 sec, 9.95 MB]
[info] Successfully connected to the Drupal database. [0.19 sec, 9.95 MB]
[info] Try to validate bootstrap phase 5 [0.19 sec, 9.95 MB]
[info] Try to bootstrap at phase 5 [0.19 sec, 9.95 MB]
[info] Drush bootstrap phase: bootstrapDrupalFull() [0.19 sec, 9.95 MB]
[debug] Start bootstrap of the Drupal Kernel. [0.19 sec, 9.95 MB]
[debug] new_relic_rpm commands loaded even though its constraint (^9) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/new_relic_rpm/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] acquia_connector commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/acquia_connector/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[debug] acquia_search commands loaded even though its constraint (^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/acquia_search/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] config_split commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/config_split/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[debug] devel commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/devel/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] devel_entity_updates commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/devel_entity_updates/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[info] entity_reference_revisions should have an extra.drush.services section in its composer.json. See https://www.drush.org/latest/commands/#specifying-the-services-file. [0.31 sec, 11.75 MB]
[debug] migrate_tools commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/migrate_tools/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[info] path_redirect_import should have an extra.drush.services section in its composer.json. See https://www.drush.org/latest/commands/#specifying-the-services-file. [0.31 sec, 11.75 MB]
[debug] search_api commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/search_api/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] search_api_solr commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/search_api_solr/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[debug] simple_sitemap commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/simple_sitemap/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[debug] token commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/token/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] upgrade_status commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/upgrade_status/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.76 MB]
[debug] webform commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/webform/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] pathauto commands loaded even though its constraint (^9 || ^10) is incompatible with Drush 11.0.9. Broaden the constraint in modules/contrib/pathauto/composer.json (see 'extra\drush\services' section) to remove this message. [0.31 sec, 11.75 MB]
[debug] Get container builder [0.32 sec, 11.77 MB]
[debug] Service modifier alter. [0.32 sec, 11.95 MB]
[debug] process drush.console.services console.command [0.4 sec, 17.95 MB]
[debug] process drush.command.services drush.command [0.4 sec, 17.95 MB]
[debug] Found tagged service config.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service config.export.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service config.import.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service batch.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service cli.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service drupal.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service deploy_hook.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service entity.commands [0.4 sec, 17.95 MB]
[debug] Found tagged service link.hooks [0.4 sec, 17.95 MB]
[debug] Found tagged service image.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service jsonapi.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service language.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service locale.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service messenger.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service migrate_runner.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service queue.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service role.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service state.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service twig.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service user.commands [0.4 sec, 17.96 MB]
[debug] Found tagged service views.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service watchdog.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service field.create.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service field.info.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service field.delete.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service field.base-override-create.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service field.base-info.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service pm.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service theme.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service sanitize.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service sanitize.comments.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service sanitize.sessions.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service sanitize.userfields.commands [0.4 sec, 17.97 MB]
[debug] Found tagged service sanitize.usertable.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service new_relic_rpm.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service acquia_connector.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service acquia_search.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service config_split.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service devel.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service devel_entity_updates.command [0.4 sec, 17.98 MB]
[debug] Found tagged service entity_reference_revisions.commands [0.4 sec, 17.98 MB]
[debug] Found tagged service migrate_tools.commands [0.41 sec, 17.98 MB]
[debug] Found tagged service path_redirect_import.commands [0.41 sec, 17.98 MB]
[debug] Found tagged service search_api.commands [0.41 sec, 17.98 MB]
[debug] Found tagged service search_api_solr.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service simple_sitemap.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service token.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service upgrade_status.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service webform.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service webform.sanitize.submissions.commands [0.41 sec, 17.99 MB]
[debug] Found tagged service pathauto.commands [0.41 sec, 17.99 MB]
[debug] process drush.command_info_alterer.services drush.command_info_alterer [0.41 sec, 17.99 MB]
[debug] process drush.generator.services drush.generator.v2 [0.41 sec, 17.99 MB]
[debug] Finished bootstrap of the Drupal Kernel. [0.98 sec, 31.84 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\config\ConfigCommands [1.42 sec, 51.54 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\config\ConfigExportCommands [1.42 sec, 51.58 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\config\ConfigImportCommands [1.42 sec, 51.59 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\BatchCommands [1.43 sec, 51.59 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\CliCommands [1.43 sec, 51.6 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\DrupalCommands [1.43 sec, 51.6 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\DeployHookCommands [1.43 sec, 51.62 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\EntityCommands [1.43 sec, 51.63 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\LinkHooks [1.43 sec, 51.65 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\ImageCommands [1.43 sec, 51.65 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\JsonapiCommands [1.43 sec, 51.66 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\LanguageCommands [1.43 sec, 51.67 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\LocaleCommands [1.43 sec, 51.68 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\MessengerCommands [1.43 sec, 51.7 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\MigrateRunnerCommands [1.43 sec, 51.7 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\QueueCommands [1.44 sec, 51.75 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\RoleCommands [1.44 sec, 51.77 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\StateCommands [1.44 sec, 51.79 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\TwigCommands [1.44 sec, 51.81 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\UserCommands [1.44 sec, 51.81 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\ViewsCommands [1.44 sec, 51.86 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\core\WatchdogCommands [1.44 sec, 51.89 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\field\FieldCreateCommands [1.47 sec, 51.93 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\field\FieldInfoCommands [1.47 sec, 51.94 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\field\FieldDeleteCommands [1.47 sec, 51.94 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\field\FieldBaseOverrideCreateCommands [1.47 sec, 51.95 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\field\FieldBaseInfoCommands [1.47 sec, 51.96 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\pm\PmCommands [1.47 sec, 51.96 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\pm\ThemeCommands [1.47 sec, 51.98 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\sql\SanitizeCommands [1.48 sec, 51.98 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\sql\SanitizeCommentsCommands [1.48 sec, 51.99 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\sql\SanitizeSessionsCommands [1.48 sec, 51.99 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\sql\SanitizeUserFieldsCommands [1.48 sec, 51.99 MB]
[debug] Add a commandfile class: Drush\Drupal\Commands\sql\SanitizeUserTableCommands [1.48 sec, 52 MB]
[debug] Add a commandfile class: Drupal\new_relic_rpm\Commands\NewRelicRpmCommands [1.48 sec, 52.01 MB]
[debug] Add a commandfile class: Drupal\acquia_connector\Commands\AcquiaConnectorCommands [1.48 sec, 52.01 MB]
[debug] Add a commandfile class: Drupal\acquia_search\Commands\AcquiaSearchCommands [1.48 sec, 52.02 MB]
[debug] Add a commandfile class: Drupal\config_split\Commands\ConfigSplitCommands [1.48 sec, 52.04 MB]
[debug] Add a commandfile class: Drupal\devel\Commands\DevelCommands [1.48 sec, 52.05 MB]
[debug] Add a commandfile class: Drupal\devel_entity_updates\Commands\DevelEntityUpdatesCommands [1.48 sec, 52.07 MB]
[debug] Add a commandfile class: Drupal\entity_reference_revisions\Commands\EntityReferenceRevisionsCommands [1.48 sec, 52.08 MB]
[debug] Add a commandfile class: Drupal\migrate_tools\Commands\MigrateToolsCommands [1.48 sec, 52.08 MB]
[debug] Add a commandfile class: Drupal\path_redirect_import\Commands\PathRedirectImport [1.49 sec, 52.09 MB]
[debug] Add a commandfile class: Drupal\search_api\Commands\SearchApiCommands [1.49 sec, 52.09 MB]
[debug] Add a commandfile class: Drupal\search_api_solr\Commands\SearchApiSolrCommands [1.49 sec, 52.17 MB]
[debug] Add a commandfile class: Drupal\simple_sitemap\Commands\SimpleSitemapCommands [1.49 sec, 52.2 MB]
[debug] Add a commandfile class: Drupal\token\Commands\TokenCommands [1.49 sec, 52.2 MB]
[debug] Add a commandfile class: Drupal\upgrade_status\Commands\UpgradeStatusCommands [1.49 sec, 52.21 MB]
[debug] Add a commandfile class: Drupal\webform\Commands\WebformCommands [1.49 sec, 52.23 MB]
[debug] Add a commandfile class: Drupal\webform\Commands\WebformSanitizeSubmissionsCommands [1.49 sec, 52.3 MB]
[debug] Add a commandfile class: Drupal\pathauto\Commands\PathautoCommands [1.49 sec, 52.3 MB]
[info] Executing: /home/ide/project/vendor/bin/drush updatedb:status --verbose --yes --strict=0 --uri=https://DOMAINREMOVED.cloud --root=/home/ide/project/docroot [2.32 sec, 59.46 MB]
-------- ----------------- ------------- ----------------------------------
Module Update ID Type Description
-------- ----------------- ------------- ----------------------------------
views sort_identifier post-update Add the identifier option to all
sort handler configurations.
-------- ----------------- ------------- ----------------------------------

// Do you wish to run the specified pending updates?: yes.

[info] Executing: /home/ide/project/vendor/bin/drush updatedb:batch-process 45693 --uri=https://DOMAINREMOVED.cloud --root=/home/ide/project/docroot [4.23 sec, 59.94 MB]
> [notice] Update started: views_post_update_sort_identifier
> [warning] Drush command terminated abnormally.

In ProcessBase.php line 155:

[InvalidArgumentException]
Output is empty.

Exception trace:
at /home/ide/project/vendor/consolidation/site-process/src/ProcessBase.php:155
Consolidation\SiteProcess\ProcessBase->getOutputAsJson() at /home/ide/project/vendor/drush/drush/includes/batch.inc:152
_drush_backend_batch_process() at /home/ide/project/vendor/drush/drush/includes/batch.inc:75
drush_backend_batch_process() at /home/ide/project/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:426
Drush\Commands\core\UpdateDBCommands->updateBatch() at /home/ide/project/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:72
Drush\Commands\core\UpdateDBCommands->updatedb() at n/a:n/a
call_user_func_array() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:257
Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:212
Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:176
Consolidation\AnnotatedCommand\CommandProcessor->process() at /home/ide/project/vendor/consolidation/annotated-command/src/AnnotatedCommand.php:350
Consolidation\AnnotatedCommand\AnnotatedCommand->execute() at /home/ide/project/vendor/symfony/console/Command/Command.php:255
Symfony\Component\Console\Command\Command->run() at /home/ide/project/vendor/symfony/console/Application.php:1027
Symfony\Component\Console\Application->doRunCommand() at /home/ide/project/vendor/symfony/console/Application.php:273
Symfony\Component\Console\Application->doRun() at /home/ide/project/vendor/symfony/console/Application.php:149
Symfony\Component\Console\Application->run() at /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php:124
Drush\Runtime\Runtime->doRun() at /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php:51
Drush\Runtime\Runtime->run() at /home/ide/project/vendor/drush/drush/drush.php:72
require() at /home/ide/project/vendor/drush/drush/drush:4
include() at /home/ide/project/vendor/bin/drush:117

Output of local update.php:
The update begins then the page fails to load and no log entries are made.

**** Cloud instance ****

Output of cloud "drush status":
Drupal version : 9.3.16
Site URI : http://DOMAINREMOVED.com
DB driver : mysql
DB hostname : db-12542eca35cc4f919978abeffcdd363e.cdb.database.services.acquia.io
DB port : 3306
DB username : uJXV0sl1xDOQjdyk
DB name : 12542eca35cc4f919978abeffcdd363e
Database : Connected
Drupal bootstrap : Successful
Default theme : regis
Admin theme : seven
PHP binary : /usr/local/php8.0/bin/php
PHP config : /usr/local/php8.0/etc/cli/php.ini
PHP OS : Linux
Drush script : /var/www/html/vendor/drush/drush/drush
Drush version : 11.0.9
Drush temp : /tmp
Drush configs : /etc/drush/drush.yml
/mnt/env-config/..2022_06_16_17_49_48.172490911/drush/drush.yml
/var/www/html/vendor/drush/drush/drush.yml
Install profile : standard
Drupal root : /var/www/html/docroot
Site path : sites/default
Files, Public : sites/default/files
Files, Private : /shared/sites/default/files-private
Files, Temp : /tmp

Output of cloud "drush updb -d -y" with the patch #51 applied:
Using the Drush script found at /home/ide/project/vendor/bin/drush using pcntl_exec
[preflight] Config paths: /home/ide/.drush/drush.yml,/home/ide/project/vendor/drush/drush/drush.yml
[preflight] Alias paths: /home/ide/project/docroot/drush/sites,/home/ide/project/drush/sites
[preflight] Commandfile search paths: /home/ide/project/vendor/drush/drush/src,/home/ide/project/docroot/drush,/home/ide/project/drush
[debug] Redispatch hook updb [0.08 sec, 8.96 MB]
[info] Executing: ssh -o PasswordAuthentication=no regis.dev@DOMAINREMOVED.com 'drush9 updb -vvv -y --uri=DOMAINREMOVED.com --root=/var/www/html/docroot' [0.09 sec, 9.47 MB]

Deprecated: Required parameter $args follows optional parameter $command in /usr/local/drush9/vendor/drush/drush/includes/batch.inc on line 115

Deprecated: Required parameter $options follows optional parameter $command in /usr/local/drush9/vendor/drush/drush/includes/batch.inc on line 115
---------- ------------------- --------------- -------------------------------
Module Update ID Type Description
---------- ------------------- --------------- -------------------------------
user 9301 hook_update_n 9301 - Change the users table
to use an serial uid field.
block replace_node_type post-update Updates the node type
_condition visibility condition.
media modify_base_field post-update Updates stale references to
_author_override Drupal\media\Entity\Media::ge
tCurrentUserId.
node modify_base_field post-update Updates stale references to
_author_override Drupal\node\Entity\Node::getC
urrentUserId.
node rebuild_node_revi post-update Rebuild the node revision
sion_routes routes.
system delete_authorize_ post-update Remove obsolete
settings system.authorize
configuration.
system sort_all_config post-update Sort all configuration
according to its schema.
taxonomy clear_views_argum post-update Clear the cache after
ent_validator_plu deprecating Term views
gins_cache argument validator.
user update_roles post-update Calculate role dependencies
and remove non-existent
permissions.
views sort_identifier post-update Add the identifier option to
all sort handler
configurations.
---------- ------------------- --------------- -------------------------------

// Do you wish to run the specified pending updates?: yes.

In SiteProcess.php line 214:

[Symfony\Component\Process\Exception\ProcessFailedException]
The command "ssh -o PasswordAuthentication=no regis.dev@DOMAINREMOVED.com 'drush9 updb -vvv -y --uri=DOMAINREMOVED.com --root=/var/www/html/docroot'
" failed.

Exit Code: 1(General error)

Working directory:

Output:
================

Deprecated: Required parameter $args follows optional parameter $command in /usr/local/drush9/vendor/drush/drush/includes/batch.inc on line 115

Deprecated: Required parameter $options follows optional parameter $command in /usr/local/drush9/vendor/drush/drush/includes/batch.inc on line 115
---------- ------------------- --------------- -------------------------------
Module Update ID Type Description
---------- ------------------- --------------- -------------------------------
user 9301 hook_update_n 9301 - Change the users table
to use an serial uid field.
block replace_node_type post-update Updates the node type
_condition visibility condition.
media modify_base_field post-update Updates stale references to
_author_override Drupal\media\Entity\Media::ge
tCurrentUserId.
node modify_base_field post-update Updates stale references to
_author_override Drupal\node\Entity\Node::getC
urrentUserId.
node rebuild_node_revi post-update Rebuild the node revision
sion_routes routes.
system delete_authorize_ post-update Remove obsolete
settings system.authorize
configuration.
system sort_all_config post-update Sort all configuration
according to its schema.
taxonomy clear_views_argum post-update Clear the cache after
ent_validator_plu deprecating Term views
gins_cache argument validator.
user update_roles post-update Calculate role dependencies
and remove non-existent
permissions.

Output of cloud Update.php:

An AJAX HTTP error occurred.
HTTP Result Code: 500
Debugging information follows.
Path: /update.php/start?id=45701&op=do_nojs&op=do
StatusText: error
ResponseText:

The update process was aborted prematurely while running update # in views_post_update_sort_identifier.module. All errors have been logged. You may need to check the watchdog database table manually.

Error logged:

Type php
Date Thursday, June 16, 2022 - 14:04
User Daniel.Lyons@r…
Location https://DOMAINREMOVED.com/update.php/results
Referrer https://DOMAINREMOVED.com/update.php/start?id=45701&op=start
Message Warning: Undefined array key 1 in Drupal\system\Controller\DbUpdateController->results() (line 423 of /var/www/html/docroot/core/modules/system/src/Controller/DbUpdateController.php)
#0 /var/www/html/docroot/core/includes/bootstrap.inc(346): _drupal_error_handler_real()
#1 /var/www/html/docroot/core/modules/system/src/Controller/DbUpdateController.php(423): _drupal_error_handler()
#2 /var/www/html/docroot/core/modules/system/src/Controller/DbUpdateController.php(179): Drupal\system\Controller\DbUpdateController->results()
#3 [internal function]: Drupal\system\Controller\DbUpdateController->handle()
#4 /var/www/html/docroot/core/lib/Drupal/Core/Update/UpdateKernel.php(115): call_user_func_array()
#5 /var/www/html/docroot/core/lib/Drupal/Core/Update/UpdateKernel.php(76): Drupal\Core\Update\UpdateKernel->handleRaw()
#6 /var/www/html/docroot/update.php(27): Drupal\Core\Update\UpdateKernel->handle()
#7 {main}
.
Severity Warning
Hostname IPREMOVED
Operations

I have run into the same issue on my site. I just updated from drupal 8.9.20 to the latest version and when I tried to run drush updb it got to the system_post_update_sort_all_config update and then gave me the "Output is empty" error.
When I tried to run it through update.php I got this error response

Notice: Undefined offset: 1 in Drupal\system\Controller\DbUpdateController->results() (line 423 of core/modules/system/src/Controller/DbUpdateController.php).
Drupal\system\Controller\DbUpdateController->results(Object) (Line: 179)
Drupal\system\Controller\DbUpdateController->handle('results', Object)
call_user_func_array(Array, Array) (Line: 115)
Drupal\Core\Update\UpdateKernel->handleRaw(Object) (Line: 76)
Drupal\Core\Update\UpdateKernel->handle(Object) (Line: 27)

I was directed here from drupal StackExchange and I applied the patch in comment #51 and reran drush updb and it still failed but I got a little more info

[notice] core.entity_form_display.paragraph.new_download_cta.default [2.24 sec, 60.08 MB]
> Segmentation fault

In ProcessBase.php line 171:
                                                                                    
  [InvalidArgumentException]                                                        
  Unable to decode output into JSON: Syntax error                                   
                                                                                    
  Box Requirements Checker                                                          
  ========================                                                          
                                                                                    
  > Using PHP 7.4.30                                                                
  > PHP is using the following php.ini file:                                        
    /usr/local/php7.4/etc/cli/php.ini                                               
                                                                                    
  > Checking Box requirements:                                                      
    ✔ The package "composer/xdebug-handler" requires the version "^5.3.2 || ^7.0    
  || ^8.0" or greater.                                                              
    ✔ The package "laravel-zero/phar-updater" requires the version "^7.3|^8.0" or   
  greater.                                                                          
    ✔ The package "psr/log" requires the version ">=5.3.0" or greater.              
    ✔ The package "symfony/polyfill-ctype" requires the version ">=7.1" or          
  greater.                                                                          
    ✔ The package "webmozart/assert" requires the version "^7.2 || ^8.0" or         
  greater.                                                                          
    ✔ The package "webmozart/path-util" requires the version ">=5.3.3" or greater.  
    ✔ The package "webflo/drupal-finder" requires the extension "json".             
                                                                                    
                                                                                    
   [OK] Your system is ready to run the application.                                
                                                                                    

Exception trace:
  at /home/ide/project/vendor/consolidation/site-process/src/ProcessBase.php:171
 Consolidation\SiteProcess\ProcessBase->getOutputAsJson() at /home/ide/project/vendor/drush/drush/includes/batch.inc:157
 _drush_backend_batch_process() at /home/ide/project/vendor/drush/drush/includes/batch.inc:80
 drush_backend_batch_process() at /home/ide/project/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:472
 Drush\Commands\core\UpdateDBCommands->updateBatch() at /home/ide/project/vendor/drush/drush/src/Commands/core/UpdateDBCommands.php:83
 Drush\Commands\core\UpdateDBCommands->updatedb() at n/a:n/a
 call_user_func_array() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:257
 Consolidation\AnnotatedCommand\CommandProcessor->runCommandCallback() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:212
 Consolidation\AnnotatedCommand\CommandProcessor->validateRunAndAlter() at /home/ide/project/vendor/consolidation/annotated-command/src/CommandProcessor.php:176
 Consolidation\AnnotatedCommand\CommandProcessor->process() at /home/ide/project/vendor/consolidation/annotated-command/src/AnnotatedCommand.php:350
 Consolidation\AnnotatedCommand\AnnotatedCommand->execute() at /home/ide/project/vendor/symfony/console/Command/Command.php:255
 Symfony\Component\Console\Command\Command->run() at /home/ide/project/vendor/symfony/console/Application.php:1027
 Symfony\Component\Console\Application->doRunCommand() at /home/ide/project/vendor/symfony/console/Application.php:273
 Symfony\Component\Console\Application->doRun() at /home/ide/project/vendor/symfony/console/Application.php:149
 Symfony\Component\Console\Application->run() at /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php:118
 Drush\Runtime\Runtime->doRun() at /home/ide/project/vendor/drush/drush/src/Runtime/Runtime.php:48
 Drush\Runtime\Runtime->run() at /home/ide/project/vendor/drush/drush/drush.php:72
 require() at /home/ide/project/vendor/drush/drush/includes/preflight.inc:18
 drush_main() at phar:///usr/local/bin/drush/bin/drush.php:143
 require() at /usr/local/bin/drush:14

Has anyone found out how to fix this yet?

I have run into the same issue on my site, is anyone found the fix for this issue? I have updated my application from v9.2.6 to 9.4.8 .

when I tried to run drush updb, it got to the system_post_update_sort_all_config update and then gave me the below error
> Segmentation fault (core dumped)
In ProcessBase.php line 155:
Output is empty.

When I tried to run it through update.php I got this error response :

An AJAX HTTP error occurred.
HTTP Result Code: 502
Debugging information follows.
Path: /update.php/start?id=73&op=do_nojs&op=do
StatusText: error
ResponseText:
Error 502html{font-family:"Helvetica Neue", Helvetica, Arial, sans-serif;font-weight:300;background-color:#eee;}h1{font-weight:100;}body{margin:3em;}img{display:block;width:100px;height:100px;margin:0 auto;}div{max-width:20em;margin:0 auto;text-align:center;}502 Bad Gateway

Has anyone found out how to fix this ?

We stumbled upon the same issue while upgrading to drupal core 9.4, in case this might help to someone else, in our case the problem was related to the version of a contrib module link_target, that didn't work with version 1.4 spitting out the above mentioned notorious error i.e.

Update aborted by system_post_update_sort_all_config. Drush command terminated abnormally. Output is empty

So, we solved the problem by downgrading the module link_target to version 1.3.0

Ara Martirsyan, how did you figure out that link_target was the issue?

I just switched it and this solution worked for me

@just_jordan well by debugging the code we realised that the configs on which the error was spat were always the ones related to field links
and the pattern was always the same all the fields used the same form field widget, so the colleague of mine suggested to try a different version of the module. I am glad that the solution at least helped someone.

I put the workarounds in the issue summary, all of which are related to contrib modules.

Also, note that the function system_post_update_sort_all_config has been updated in 9.4.x and 9.5.x so that the exception message is logged.

In order to progress here this needs steps to reproduce as was stated in #18. If you are experiencing this problem provide complete steps to reproduce the issue (starting from "Install Drupal core").

Thanks

best regard

I am new to drupal and I have the same error, can you help me thanks

my site is in drupal 9.5.7 and when executing update.php through the browser I get the error.

Warning: Undefined array key 1 in Drupal\system\Controller\DbUpdateController->results() (line 423 of core/modules/system/src/Controller/DbUpdateController.php).
Drupal\system\Controller\DbUpdateController->results(Object) (Line: 179)
Drupal\system\Controller\DbUpdateController->handle('results', Object)
call_user_func_array(Array, Array) (Line: 115)
Drupal\Core\Update\UpdateKernel->handleRaw(Object) (Line: 76)
Drupal\Core\Update\UpdateKernel->handle(Object) (Line: 27)
The update process was aborted prematurely while running update # in system_post_update_sort_all_config.module. All errors have been logged. You may need to check the watchdog database table manually.

a:6:{s:5:"%type";s:7:"Warning";s:8:"@message";O:25:"Drupal\Core\Render\Markup":1:{s:9:" * string";s:21:"Undefined array key 1";}s:9:"%function";s:54:"Drupal\system\Controller\DbUpdateController->results()";s:5:"%file";s:86:"/home/cvc/public_html/prueba/core/modules/system/src/Controller/DbUpdateController.php";s:5:"%line";i:423;s:17:"@backtrace_string";s:1091:"#0 /home/cvc/public_html/prueba/core/includes/bootstrap.inc(347): _drupal_error_handler_real(2, 'Undefined array...', '/home/cvc/publi...', 423)
#1 /home/cvc/public_html/prueba/core/modules/system/src/Controller/DbUpdateController.php(423): _drupal_error_handler(2, 'Undefined array...', '/home/cvc/publi...', 423)
#2 /home/cvc/public_html/prueba/core/modules/system/src/Controller/DbUpdateController.php(179): Drupal\system\Controller\DbUpdateController->results(Object(Symfony\Component\HttpFoundation\Request))
#3 [internal function]: Drupal\system\Controller\DbUpdateController->handle('results', Object(Symfony\Component\HttpFoundation\Request))
#4 /home/cvc/public_html/prueba/core/lib/Drupal/Core/Update/UpdateKernel.php(115): call_user_func_array(Array, Array)
#5 /home/cvc/public_html/prueba/core/lib/Drupal/Core/Update/UpdateKernel.php(76): Drupal\Core\Update\UpdateKernel->handleRaw(Object(Symfony\Component\HttpFoundation\Request))
#6 /home/cvc/public_html/prueba/update.php(27): Drupal\Core\Update\UpdateKernel->handle(Object(Symfony\Component\HttpFoundation\Request))
#7 {main}";}

Hello,

I re-rolled the #51 patch for the 9.5.7 Drupal core.

Thanks, I hope it helps.

Hello again,

Sorry for the duplicity of comments: I am new and this is my first time.

I attach the correct file.

Thank you.

Any news here? I tried to update from 9.2.21 to 9.3.15 and get the same error:

In ProcessBase.php line 171:
                                                                                                                                                                                          
  [InvalidArgumentException]                                                                                                                                                              
  Unable to decode output into JSON: Syntax error                                                                                                                                         
                                                                                                                                                                                          
  Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 262144 bytes) in /core/lib/Drupal/Core/Config/TypedConfigManage  
  r.php on line 200                                                                                                                                                                       
                                                                                                                                                                                          
  Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 262144 bytes) in /vendor/drush/drush/src/Boot/DrupalBoot8.php on line 305

Hi @einarulfhednar

I have applied the patch provided by you(#68) but some how it worked then again getting the same error.

Drush updb giving the below error

[notice] core.entity_form_display.paragraph.banner_a_3_0.default
> [notice] core.entity_form_display.paragraph.banner_a_4_0.default
> [notice] core.entity_form_display.paragraph.banner_b_3_0.default
> Killed

In ProcessBase.php line 155:

Output is empty.

Thanks
Monali

Both "Fatal error: Allowed memory size of X bytes exhausted" and "Killed" in #69 and #70 imply that Drush is running out of memory when processing the updates - increase your memory_limit if possible.

Steps to reproduce were asked for 2 years ago and have not been provided. Ways to work around are in the Issue Summary and #71 explains that at least one error is that drush is running out of memory.

The Drupal Core issue queue is not the ideal place for support requests (that option is mostly there for filing support issues for contributed modules and themes). There are several support options listed on our support page (Community > Support at the top of Drupal.org) and there is Drupal Slack. Drupal Slack and the Forums, which are our two main support mechanisms in the Drupal community.

I'm getting the same message. In my case, I'm just enabling the Superfish module and the message appears after translations are fetched and imported. Drupal version is 10.4.5 and Drush version is 13.4.0.0. Below is the complete output:

dreen superfish
 [success] Successfully uninstalled: superfish
>  [notice] Checked de translation for superfish.
>  [notice] Checked tr translation for superfish.
>  [notice] Downloaded de translation for superfish.
>  [notice] Imported de translation for superfish.
>  [notice] Downloaded tr translation for superfish.
>  [notice] Imported tr translation for superfish.
> Killed

In ProcessBase.php line 155:

  Output is empty.

EDIT: It doesn't happen with Drupal version 10.4.6 and Drush version 13.6.0.0, if that matters.

@kartagis, Support requests are best handled in the other channels I mentioned in #73. The output includes "In ProcessBase.php line 155:" and I can find no history of that file in the Drupal code. So, it seems the source of the problem is elsewhere?

I am closing this per the guidance in Handle or refer a support request in an issue.