Problem/Motivation

Hello,

Since 3.19 when I try to verify a site I have a error :

Executing: rsync -e 'ssh ' -akzv --exclude=".git" --exclude=".gitignore" --exclude=".hg" --exclude=".hgignore" --exclude=".hgrags" --exclude=".bzr" --exclude=".bzrignore" --exclude=".bzrtags" --exclude=".svn" --exclude="files/*" --exclude="private/*" --stats --progress --relative --keep-dirlinks --omit-dir-times --delete 'sites/example.univ-amu.fr/files' 'aegir@dev.univ-amu.fr:/'
sending incremental file list
rsync: recv_generator: mkdir "/sites" failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
sites/

Number of files: 3 (dir: 3)
Number of created files: 1 (dir: 1)
Number of deleted files: 0
Number of regular files transferred: 0
Total file size: 0 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 0
File list generation time: 0.001 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 316
Total bytes received: 163

sent 316 bytes received 163 bytes 958.00 bytes/sec
total size is 0 speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
Could not rsync from 'sites/example.univ-amu.fr/files' to 'aegir@dev.univ-amu.fr:/' [1.71 sec, 12.71 MB] [error]
sites/example.univ-amu.fr/files could not be synced to remote server dev.univ-amu.fr. Changes might not be available [error]
until this has been done. (error: sending incremental file list
rsync: recv_generator: mkdir "/sites" failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
sites/

Precision : our directory /platforms is a symbolic link to another ssd.
lrwxrwxrwx 1 root root 25 juil. 17 2017 platforms -> /data-platforms/platforms/

Steps to reproduce

drush @example.univ-amu.fr provision-verify --debug

Thks

CommentFileSizeAuthor
#15 3186056-15-undo-merge-devshop.patch24.31 KBhelmo
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

robby78 created an issue. See original summary.

colan’s picture

colan
he/him
Primary language English
Location Toronto 🇨🇦
CreditAttribution: colan at Consensus Enterprises commented
Category: Bug report » Support request

rsync: recv_generator: mkdir "/sites" failed: Permission denied (13)

Looks like this is a permission issue. Try to fix, and then try running the Verify again?

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented
Priority: Normal » Major

I am getting the same issue - was introduced in latest Aegir release.

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

Looking at the error it seems like it is trying to rsync the sites directory at the filesystem root (so not surprising it fails) on the remote server.

helmo’s picture

helmo CreditAttribution: helmo as a volunteer and at Initfour websolutions commented

My slack comment from yesterday:

I don't have time to investigate now ... but commit https://git.drupalcode.org/project/provision/-/commit/49a280dbe74247d0d2... might be related here

The old .deb files can be found in GitLab's pipeline artifacts:
https://gitlab.com/aegir/provision/pipelines?page=1&scope=all&ref=7.x-3.186

direct link: https://gitlab.com/aegir/provision/-/jobs/601912677/artifacts/download?f...

helmo’s picture

helmo CreditAttribution: helmo as a volunteer and at Initfour websolutions commented

Slack:

@Robby you could also try to unto the commit I mentioned yesterday ... in /usr/share/drush/commands/provision wget https://git.drupalcode.org/project/provision/-/commit/49a280dbe74247d0d2... patch -p1 -R < 49a280dbe74247d0d2eee786c0c46ff91e2502f5.patch

@ac Could you try this?

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

@helmo just tried that - didn't work.

colan’s picture

colan
he/him
Primary language English
Location Toronto 🇨🇦
CreditAttribution: colan at Consensus Enterprises commented
Category: Support request » Bug report
robby78’s picture

robby78 CreditAttribution: robby78 commented
Category: Bug report » Support request

Same error for me with the patch

colan’s picture

colan
he/him
Primary language English
Location Toronto 🇨🇦
CreditAttribution: colan at Consensus Enterprises commented
Category: Support request » Bug report

Fixing status.

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

Reporting my findings:

If I roll provision back to Commit 0ddc74ee I can verify again. If I move to commit 60b7a2e6 it fails, so the likely culprit here is:

https://git.drupalcode.org/project/provision/commit/60b7a2e

helmo’s picture

helmo CreditAttribution: helmo as a volunteer and at Initfour websolutions commented

Me merging in the 7.x-3.x-devshop branch was too optimistic.

After chatting with Jon I reverted two commits on the 7.x-3.19.x branch to prepare for a quick release.

We're working on updates in the 7.x-3.19.x branch. Updated deb packages can be tested from our 'testing' repo or directly downloaded from GitLab https://gitlab.com/aegir/provision/-/pipelines?page=1&scope=all&ref=7.x-...

Please verify that these packages fix the problem.

robby78’s picture

robby78 CreditAttribution: robby78 commented

Hello,

Sorry but I still have the problem with the 3.191. I downgraded to 3.186 and everything is ok.

/var/aegir/platforms/drupal8-test/sites/example.univ-amu.fr has been synced to remote server dev.univ-amu.fr. [1.56 sec, 12.69 MB]                                                                                                                                      [notice]
Executing: rsync -e 'ssh ' -akzv --exclude=".git" --exclude=".gitignore" --exclude=".hg" --exclude=".hgignore" --exclude=".hgrags" --exclude=".bzr" --exclude=".bzrignore" --exclude=".bzrtags" --exclude=".svn" --exclude="files/*" --exclude="private/*" --stats --progress --relative --keep-dirlinks --omit-dir-times --delete 'sites/example.univ-amu.fr/files' 'aegir@dev.univ-amu.fr:/'
  sending incremental file list
  rsync: recv_generator: mkdir "/sites" failed: Permission denied (13)
  *** Skipping any contents from this failed directory ***
  sites/

  Number of files: 3 (dir: 3)
  Number of created files: 1 (dir: 1)
  Number of deleted files: 0
  Number of regular files transferred: 0
  Total file size: 0 bytes
  Total transferred file size: 0 bytes
  Literal data: 0 bytes
  Matched data: 0 bytes
  File list size: 0
  File list generation time: 0.001 seconds
  File list transfer time: 0.000 seconds
  Total bytes sent: 316
  Total bytes received: 163

  sent 316 bytes  received 163 bytes  958.00 bytes/sec
  total size is 0  speedup is 0.00
  rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1183) [sender=3.1.1]
Could not rsync from 'sites/example.univ-amu.fr/files' to 'aegir@dev.univ-amu.fr:/' [1.85 sec, 12.7 MB]                                                                                                                                                              [error]
sites/example.univ-amu.fr/files could not be synced to remote server dev.univ-amu.fr. Changes might not be available until this has been done. (error: sending incremental file list                                                                                 [error]
rsync: recv_generator: mkdir "/sites" failed: Permission denied (13)
*** Skipping any contents from this failed directory ***
sites/
ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

Yes same here - still can't verify with 3.191. Rolling back provision to commit 0ddc74ee also works as a hot fix for me.

helmo’s picture

helmo CreditAttribution: helmo as a volunteer and at Initfour websolutions commented
Status: Active » Needs review
FileSize
3186056-15-undo-merge-devshop.patch24.31 KB

Could you test on this commit? https://git.drupalcode.org/project/provision/commit/39b50ec3ea9ed0967d20...
It directly follows the 3.19.1 release.

And if that does not help try the attached patch which reverts the rest of the merge I did from 7.x-3.x-devshop.

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

Thanks for your work on this Helmo.

I can confirm that commit 39b50ec3ea9ed0967d2002ac6604521f544bbe28 does still not allow verifying.

Applying your patch to this commit (I assume this was the intention as it doesn't apply against HEAD) then allows me to verify successfully again.

helmo’s picture

helmo CreditAttribution: helmo as a volunteer and at Initfour websolutions commented
Status: Needs review » Fixed

The patch was against the 7.x-3.19.x branch. I've now tagged this as 3.19.2 and pushed it to our stable repo.

robby78’s picture

robby78 CreditAttribution: robby78 commented

Same for me, everything is ok

Thks a lot

ac’s picture

ac
Primary language English
Location Perth
CreditAttribution: ac commented

@robby78 can you have a look at this and see if you have the same issue https://www.drupal.org/project/provision/issues/3188197

Can you also see if you can create a new platform?

robby78’s picture

robby78 CreditAttribution: robby78 commented

Hello,

Everything is ok for me
Create platform D8 : OK
Verify : OK

Status: Fixed » Closed (fixed)

Automatically closed - issue fixed for 2 weeks with no activity.