Hello
I have tried and tried and tried and Re tried , checked re checked and redone a dozen times and I really can't set up aegir properly.
More importantly it fails without giving me much clues about WHY it fails.

when I get to the step "Verify your configuration"
the check fails this way 

Log message
Task starts processing
Running: php /var/www/aegir/drush/drush.php --root='/var/www/aegir/drupal-6.13-AEgir' 'provision' 'verify' --backend
The external command could not be executed due to an application error.
Drush bootstrap phase : _drush_bootstrap_drush()
Drush bootstrap phase : _drush_bootstrap_drupal_root()
Initialized Drupal 6.13 root directory at /var/www/aegir/drupal-6.13-AEgir
Found command: provision verify
Initializing drush commandfile: provision_apache
Undefined index: base_url
Initializing drush commandfile: provision_drupal
Initializing drush commandfile: provision_mysql
Undefined index: db_url
Including /var/www/aegir/.drush/provision/web_server/verify.provision.inc
Including /var/www/aegir/.drush/provision/platform/verify.provision.inc
Including /var/www/aegir/.drush/provision/db_server/verify.provision.inc
Drush command could not be completed.
Output from failed command :
Removing task from hosting queue
An error occurred at function : drush_hosting_hosting_task
Changes for drush_hosting_hosting_task module have been rolled back.
Command dispatch complete

I am not sure this is related to this issue http://drupal.org/node/547522 BUT I removed all symbols from my passwords and tried to run the command this way
php /var/www/aegir/drush/drush.php --root='/var/www/aegir/drupal-6.13-AEgir' 'provision' 'verify' --verbose=2 --master_db_host=localhost --master_db_user=aegir --master_db_passwd=XXXXXX --debug
to no avail :

Drush bootstrap phase : _drush_bootstrap_drupal_root() [0.017 sec]   [bootstrap]
Initialized Drupal 6.13 root directory at                               [notice]
/var/www/aegir/drupal-6.13-AEgir [0.023 sec]
Found command: provision verify [0.024 sec]                          [bootstrap]
Initializing drush commandfile: provision_apache [0.024 sec]         [bootstrap]
Undefined index:  base_url [0.025 sec]                                  [notice]
Initializing drush commandfile: provision_drupal [0.025 sec]         [bootstrap]
Initializing drush commandfile: provision_mysql [0.025 sec]          [bootstrap]
Undefined index:  db_url [0.025 sec]                                    [notice]
Undefined index:  user [0.025 sec]                                      [notice]
Undefined index:  pass [0.025 sec]                                      [notice]
Undefined index:  host [0.025 sec]                                      [notice]
Undefined index:  host [0.025 sec]                                      [notice]
Undefined index:  scheme [0.025 sec]                                    [notice]
Undefined index:  scheme [0.025 sec]                                    [notice]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/web_server/verify.provision.inc
[0.025 sec]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/platform/verify.provision.inc [0.026
sec]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/db_server/verify.provision.inc [0.026
sec]
Drush command could not be completed. [0.026 sec]                    [error]

using the --master_db options gave :

php /var/www/aegir/drush/drush.php --root='/var/www/aegir/drupal-6.13-AEgir' 'provision' 'verify' --verbose=2 --master_db_host=localhost --master_db_user=aegir --master_db_passwd=XXXX --debug --master_db='mysqli://aegir:XXXXX@localhost'
Drush bootstrap phase : _drush_bootstrap_drupal_root() [0.017 sec]   [bootstrap]
Initialized Drupal 6.13 root directory at                               [notice]
/var/www/aegir/drupal-6.13-AEgir [0.023 sec]
Found command: provision verify [0.024 sec]                          [bootstrap]
Initializing drush commandfile: provision_apache [0.024 sec]         [bootstrap]
Undefined index:  base_url [0.025 sec]                                  [notice]
Initializing drush commandfile: provision_drupal [0.025 sec]         [bootstrap]
Initializing drush commandfile: provision_mysql [0.025 sec]          [bootstrap]
Undefined index:  db_url [0.025 sec]                                    [notice]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/web_server/verify.provision.inc
[0.025 sec]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/platform/verify.provision.inc [0.025
sec]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/db_server/verify.provision.inc [0.026
sec]
Drush command could not be completed. [0.026 sec]                    [error]

I may be on the wrong path suspecting the DB though.

I checked that i can connect to mysql with the user and such, the permission of the /var/www/aegir HOME dir

set
_       whoami

addsuffix
argv    ()
autolist
csubstnonl
cwd     /var/www/aegir/drupal-6.13-AEgir
dirstack        /var/www/aegir/drupal-6.13-AEgir
echo_style      bsd
edit
filec
gid     1002
group   aegir
history 100
home    /var/www/aegir
killring        30
loginsh
mail    /var/mail/aegir
owd     /var/www/aegir/drupal-6.13-AEgir/sites/default
path    (/sbin /bin /usr/sbin /usr/bin /usr/games /usr/local/sbin /usr/local/bin /var/www/aegir/bin)
prompt  %{\033[31m%}%n@%m:%/\t[%D-%w-%y %t]\n%{\033[37m%}%#
prompt2 %R?
prompt3 CORRECT>%R (y|n|e|a)?
savehist        100
shell   /bin/csh
shlvl   1
status  0
tcsh    6.15.00
term    xterm
tty     ttyp1
uid     1002
user    aegir
version tcsh 6.15.00 (Astron) 2007-03-03 (unknown-unknown-FreeBSD) options wide,nls,dl,al,kan,sm,rh,color,filec

FYI bash is installed and a previous try with bash as the aegir shell lead to the SAME results...

The unix used is a FreeBSD under a jail on computer I have full control off.

The home aegir directory listing :

aegir@XXXXX:/var/www/aegir        [16-Aug-09 4:12pm]                                                                                            > ll
total 20
-rw-------  1 aegir  aegir  175 Aug 16 13:16 .bash_history
-rw-r--r--  1 aegir  aegir  836 Aug 16 13:22 .cshrc
drwxr-xr-x  3 aegir  aegir  512 Aug 16 13:26 .drush
-rw-------  1 aegir  aegir  143 Aug 16 13:59 .history
-rw-------  1 aegir  aegir   21 Aug 16 15:51 .mysql_history
drwxr-xr-x  2 aegir  aegir  512 Aug 16 13:40 .ssh
drwx------  2 aegir  aegir  512 Aug 16 14:01 backups
drwxr-xr-x  3 aegir  aegir  512 Aug 16 13:47 config
drwxr-xr-x  9 aegir  aegir  512 Jul  1 20:55 drupal-6.13-AEgir
drwxr-xr-x  4 aegir  aegir  512 Aug 16 12:08 drush

and 

ll .drush/
total 2
drwxr-xr-x  5 aegir  aegir  512 Aug 14 21:35 provision

How can I have more information spitted by Drush to understand WHAT he can't complete ?

Trying to pass the step to complete the installation anyway lead to the import step and then the finalize step gives a WSOD with

Fatal error: Call to undefined function install_disable_theme() in /var/www/aegir/drupal-6.13-AEgir/profiles/hostmaster/hostmaster.forms.inc on line 310

Any idea or pointers ? I am borderline desperate after 3 days of looking around, I know I am whimp :)

CommentFileSizeAuthor
#6 550696.patch645 bytesmig5
#7 550696.patch684 bytesmig5
Support from Acquia helps fund testing for Drupal Acquia logo

Comments

Annakan’s picture

Annakan CreditAttribution: Annakan commented

I did a bit of crude hacking and simply put this into

function drush_provision_drupal_provision_verify($url = null) {
  drush_log(dt("=== STEP :!msg", array('!msg' => 'drush_provision_drupal_provision_verify')));
 [....]

and, if I get it right, that shows that the verify command is never called per see (since the message never appear even if a similar trace in "drush_provision_drupal_provision_verify_validate" shows up in the screenlog), something else happens before.

Somebody could tell me where into drush I can put traces to determine the code path and track the point where it breaks.
Drush use a dispatch mechanism, being plug-in based, and if somebody could help me put some traces in it to narrow on the point where it fails, I would be very grateful.

thanks a lot for your time all.

alphex’s picture

alphex CreditAttribution: alphex commented

I too just ventured to install RC3, as the first time I've ever installed AEGIR, and I'm getting the exact same error message working my way through the web interface to set things up.

Will give it another shot later tonight or tomorrow.

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

Please verify that the 'module' called 'install_profile_api' is inside profiles/hostmaster/modules/

If not, put it in there, and maybe clear cache, run drush updatedb, verify the platform etc again before trying a fresh provision of a site. Just to be sure.

Annakan’s picture

Annakan CreditAttribution: Annakan commented

Thanks for your input.

Yes the install_profile API module is in the right place and I have NO modules in other places than there. (learned my lesson the hard way letting drush dl install the hosting module in sites/all a previous time)

the MAIN hosting site verify fails and I can't properly complete the wizard since two steps after that I have the
"Fatal error: Call to undefined function install_disable_theme() in /var/www/aegir/drupal-6.13-AEgir/profiles/hostmaster/hostmaster.forms.inc on line 310" error.

Since I don't know what these steps do for sure (the one the verify fails and the next two ones) I am reluctant to just ignore them.

I have tried to clear caches and updatedb and the error is the same

PS: the error message must occurs in the switching to the Eldir theme since my theme is still the base Drupal theme, if it is all the last step do it is not much but I must dig in the profile code to be sure.
FYI The administration module was not enabled too so it might be the explanation of the error.
something like :
The verify step fails
so modules are not properly enabled
then the theme switching fails

The problem really lies in the verify step failing on the hosting drupal 6.

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

The "Call to undefined function install_disable_theme()" means it cannot find that function, which is a function defined by the install_profile_api. Perhaps this is failing because, as you say, the initial verify fails (so maybe it hasn't bootstrapped the install profile api from learning of its existence.. or something)

Hopefully one of the developers can spot the issue.. I haven't been able to reproduce this but will install a fresh rc3 install from the ground up tonight and see if I can.

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented
FileSize
550696.patch645 bytes

OK, I managed to reproduce this on a fresh install of rc3 on a brand new Debian Lenny virtual machine.

The issue is that nowhere in hostmaster.profile are we calling install_include to include the array of required modules we define earlier in the profile... maybe this wasn't required in earlier versions of install_profile_api or something, at least it seems to be required now and all my other install profiles that I write include this. So hostmaster doesn't even know that it should be using install profile api at the time it calls install_disable_theme. A fatal error does indeed occur just around the 'Import Sites' task in the profile and at 'Verify settings' and one cannot proceed beyond importing sites.

The attached patch fixes it. Sorry guys I know this is an ugly patch, but I'm about to crack the shits at CVS, and the fact that git over at koumbit appears not to have synced due to something wrong with the tags (or?) with this rc3 release, which has really made everything fall apart as one cannot use drush to download any of the aegir components (rc2 is always retrieved. See this ticket to see more of mig5 talking to himself about this :) ).

In any case the patch works, and I am calling install_include right at the top of hostmaster_profile_tasks().

Annakan, please apply this patch to hostmaster.profile, or simply add this line just under function hostmaster_profile_tasks(&$task, $url) { on line 84:

install_include(array_merge(hostmaster_profile_modules()));

Anyway this gets one through this fatal error, gets all the modules etc installed just fine. But just per the output of the initial verify task at 'Verify Settings', one 'Could not select the mysql database.' To me this looks to be because there is no drushrc.php generated yet for the default platform, should one exist yet from earlier in the profile tasks, or does this provision task take care of that? And if so, where would it know what database credentials to use,? meant to get it from settings.php or..?

I tried to run this from command line:

php /var/www/aegir/drush/drush.php --root='/var/www/aegir/drupal-6.13-AEgir' 'provision' 'verify' --backend --master_db 'mysqli://aegir:xxxxxx@localhost'

This time it gets 'Successfully connected to the Drupal database.' and moves on, great. Now it fails on doing a full bootstrap:

<snip>
Drush bootstrap phase : _drush_bootstrap_drupal_full()","timestamp":1250593645.51,"error":null},{"type":"error","message":"Site was not found.","timestamp":1250593645.69,"error":"PROVISION_DRUPAL_SITE_NOT_FOUND"}
<snip>

Now I need help :) as the bootstrapping stuff confuses me. Anyway I hope you get at least this far Annakan and others.

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented
Status: Active » Needs review
FileSize
550696.patch684 bytes

I managed to cvs co HEAD, cleaner patch attached

Annakan’s picture

Annakan CreditAttribution: Annakan commented

Thanks a lot I'll look into it at home in a few hours.

I have a light skin allergy to cvs could you confirm the tag of the current version the install.txt doc says -rDRUPAL-6--2-0 is that still true ?
Or is it HEAD ?

thanks a lot anyway for your help.

alphex’s picture

alphex CreditAttribution: alphex commented

I can confirm that the patch that mig5 created works.

I manually applied the patch, and Aegir comes up just fine, for me on my VM on my laptop.
Ubuntu 9.04

Thank you mig5!

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

@Annakan I think something has gone wrong with the tagging in rc3. If you downloaded any aegir components such as hosting, provision etc via drush, you may actually have the rc2 version, also because the INSTALL.txt is out of date, its instructions for checking out via cvs reference the rc2 tag/branch.. I have been screaming about this but don't know if anything's being done.

It's safer to download the components manually.. using Adrian's links in the rc3 release notes helps to ensure you've got the right versions of the modules

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

Good to hear @duran! It's possible my other verify issues are just my own and no-one elses :)

Annakan’s picture

Annakan CreditAttribution: Annakan commented
Status: Needs review » Active

ok
I did reinstall of the hostmaster profile (cleaned up the base and settings ....)

The verify step still fails but differently

Log message
Task starts processing
Running: php /var/www/aegir/drush/drush.php --root='/var/www/aegir/drupal-6.13-AEgir' 'provision' 'verify' --backend
Drush bootstrap phase : _drush_bootstrap_drush()
Drush bootstrap phase : _drush_bootstrap_drupal_root()
Initialized Drupal 6.13 root directory at /var/www/aegir/drupal-6.13-AEgir
Drush bootstrap phase : _drush_bootstrap_drupal_site()
Initialized Drupal site default at sites/default
Drush bootstrap phase : _drush_bootstrap_drupal_configuration()
Drush bootstrap phase : _drush_bootstrap_drupal_database()
Successfully connected to the Drupal database.
Drush bootstrap phase : _drush_bootstrap_drupal_full()
Drush bootstrap phase : _drush_bootstrap_drupal_login()
The command 'drush.php provision verify' could not be found.
Removing task from hosting queue
An error occurred at function : drush_hosting_hosting_task
Changes for drush_hosting_hosting_task module have been rolled back.
Command dispatch complete

but doing this
/var/www/aegir/drush/drush.php provision verify --verbose=2 --debug

gives this

> /var/www/aegir/drush/drush.php provision verify --verbose=2 --debug
Drush bootstrap phase : _drush_bootstrap_drupal_root() [0.017 sec]   [bootstrap]
Initialized Drupal 6.13 root directory at                               [notice]
/var/www/aegir/drupal-6.13-AEgir [0.023 sec]
Found command: provision verify [0.024 sec]                          [bootstrap]
Initializing drush commandfile: provision_apache [0.024 sec]         [bootstrap]
Undefined index:  base_url [0.025 sec]                                  [notice]
Initializing drush commandfile: provision_drupal [0.025 sec]         [bootstrap]
Initializing drush commandfile: provision_mysql [0.025 sec]          [bootstrap]
Undefined index:  db_url [0.025 sec]                                    [notice]
Undefined index:  user [0.025 sec]                                      [notice]
Undefined index:  pass [0.025 sec]                                      [notice]
Undefined index:  host [0.025 sec]                                      [notice]
Undefined index:  host [0.025 sec]                                      [notice]
Undefined index:  scheme [0.025 sec]                                    [notice]
Undefined index:  scheme [0.025 sec]                                    [notice]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/web_server/verify.provision.inc
[0.025 sec]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/platform/verify.provision.inc [0.026
sec]
=================== STEP :1 [0.026 sec]                                 [notice]
Including                                                            [bootstrap]
/var/www/aegir/.drush/provision/db_server/verify.provision.inc [0.026
sec]
=== STEP : drush_provision_drupal_provision_verify_validate  [0.026     [notice]
sec]
=== STEP : drush_provision_drupal_provision_verify_validate  END        [notice]
[0.026 sec]
Drush command could not be completed. [0.026 sec]                    [error]

So I am suspicious of the "The command 'drush.php provision verify' could not be found." line.
It may be true but something else if at play obviously.

The good news is that thanks to your patch I can now come to the end of the installation, even with the verify step in a failed state.

We are getting closer :)

PS; I also found that the queue is not properly consumed / run on my install even though crontab -e is showing the right command, the log show the cron running so I think it is related to the problem : something prevent the back end (drush ? ) to finish it's work.
/var/log/cron 

Aug 18 23:11:00 webserver /usr/sbin/cron[15222]: (operator) CMD (/usr/libexec/save-entropy)
Aug 18 23:11:00 webserver/usr/sbin/cron[15225]: (aegir) CMD ((php  '/var/www/aegir/drush/drush.php' --root='/var/www/aegir/drupal-6.13-AEgir'  hosting dispatch  > /dev/null))
Aug 18 23:11:02 webserver /usr/sbin/cron[15224]: (root) CMD ((php '/var/www/aegir/drush/drush.php' hosting dispatch --root='/var/www/aegir/drupal-6.13-AEgir'))
Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

Wow, ok well we are both running into verify issues post-install, but they are different verify issues. Unfortunately I don't know why drush is not 'finding' the provision and verify commands since it is clear provision is installed and in ~/.drush/ of the aegir user. Hopefully one of the developers can look at this ticket soon and help out.

Edit: how come this one ran as root?

Aug 18 23:11:02 webserver /usr/sbin/cron[15224]: (root) CMD ((php '/var/www/aegir/drush/drush.php' hosting dispatch --root='/var/www/aegir/drupal-6.13-AEgir'))
Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

Annakan: you ran this:

/var/www/aegir/drush/drush.php provision verify --verbose=2 --debug

The original command included --backend, can you try with this:

/var/www/aegir/drush/drush.php provision verify --backend --verbose=2 --debug

and see if you get any other clues?

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented
Status: Active » Reviewed & tested by the community

changing status for sake of the patch

anarcat’s picture

anarcat CreditAttribution: anarcat commented
Status: Reviewed & tested by the community » Postponed (maintainer needs more info)

So there are two separate issues here: verify fails and the install_profile_api tweak. Maybe they are related, maybe not.

I have committed a modified version of mig5's patch to the CVS tree, could you try again to see if the issue persists (with head of course)?

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

The patch works against head as expected. My verify fail issue continues, i can create a new issue for that.

anarcat’s picture

anarcat CreditAttribution: anarcat commented
Title: Verify your configuration fails logically and the next step crash the profile » install profile fails with Call to undefined function install_disable_theme()
Project: Provision » Hostmaster (Aegir)
Status: Postponed (maintainer needs more info) » Fixed

so let's keep this issue restricted to hostmaster, and please do open a separate issue. If it's the same task log as the original poster, you don't need to bother redoing all of it, but a nice summary of the discussions here would be appreciated.

Annakan’s picture

Annakan CreditAttribution: Annakan commented

because I was a big moron tonight when doing the patch stuff and played the cron install command as root :(
fortunately a previous cron was already there.
I'll redo the procedure just to be sure.

thanks for spotting this.

Anonymous’s picture

Anonymous (not verified) CreditAttribution: Anonymous commented

edit: comment irrelevant, see 553348

Status: Fixed » Closed (fixed)

Automatically closed -- issue fixed for 2 weeks with no activity.

  • Commit 97e4d90 on 599758_edit_main_site, 640952_client_preview, dev-dns, dev-features, dev-headless_install, dev-log_directory, dev-migrate_aliases, dev-multiserver-install, dev-newsiteform, dev-nginx, dev-platform_management, dev-ports, dev-purgebackup, dev-relationships, dev-restore, dev-server_nodetype, dev-services, dev-site_rename, dev-ssl, dev_dns, prod-koumbit, ssl, dev-ssl-ip-allocation-refactor, dev-1205458-move_sites_out_of_platforms, 7.x-3.x, dev-588728-views-integration, dev-1403208-new_roles, dev-helmo-3.x authored by anarcat: 
    #550696 by mig5 - load properly the modules this profile depends on...

  • Commit 97e4d90 on 599758_edit_main_site, 640952_client_preview, dev-dns, dev-features, dev-headless_install, dev-log_directory, dev-migrate_aliases, dev-multiserver-install, dev-newsiteform, dev-nginx, dev-platform_management, dev-ports, dev-purgebackup, dev-relationships, dev-restore, dev-server_nodetype, dev-services, dev-site_rename, dev-ssl, dev_dns, prod-koumbit, ssl, dev-ssl-ip-allocation-refactor, dev-1205458-move_sites_out_of_platforms, 7.x-3.x, dev-588728-views-integration, dev-1403208-new_roles, dev-helmo-3.x authored by anarcat: 
    #550696 by mig5 - load properly the modules this profile depends on...