It'd be great to have a Behat test that ran through the manual installer and could verify that all the special stuff during Panopoly's install works, for example:

  • Apps installation
  • Theme selection
  • Removing the language selector if there's only one option
  • Default configuration settings (site name, admin user, etc)

However, there's going to be a couple unique challenges with doing this:

  • We'll need a seperate build in Travis-CI to run this special test, and not install the site via drush. This test also shouldn't run normally with the other tests (although, that's just messing with tags)
  • We'll probably need some special steps to deal with some of the oddities of the installer

Anyway, this would help a lot, especially with testing updates to the Apps module, which there seem to be a lot of recently...