From, http://drupal.org/node/1705748#comment-6422184:
Actually, before we jump too fast. Based on your comment http://drupal.org/node/1717868#comment-6422150 I looked into the --verbose flag which I remember existing, but not to replace the simpletest_verbose variable.
--verbose Output detailed assertion messages in addition to summary.
Which is intended to spit out the individual row-by-row messages (assertions) in the output of the run-tests.sh script. Which is quite different from the simpletest_verbose variable which was to control the verbose page capturing functionality in DrupalWebTestCase.We probably want to split these out and rename one. May also want to default to false on the command line? dunno.
I think --verbose flag as it stand now works the way that is most consistent with other scripts and makes sense. Perhaps we rename simpletest_verbose variable to 'capture' or something along those lines to 'capture browser shot' etc. I don't like those names just providing a thought basis.
If we default cli to false then using the cli then might do.
--print-details --verbose
--print-details to print out assertion messages
--print-results
--results
--details
,etc
Once committed http://drupal.org/node/1719530#comment-6427162 should be reverted.
Comment | File | Size | Author |
---|---|---|---|
#15 | 1774002.14.patch | 4.29 KB | gaurav_varshney |
#12 | 1774002.12.patch | 4.4 KB | alexpott |
#9 | 1774002-9-verbose-browser.patch | 1.2 KB | boombatower |
#6 | 1774002-6-verbose-browser.patch | 1.54 KB | boombatower |
Comments
Comment #1
sunI actually don't quite understand the differentiation you're trying to make -- can you clarify a bit more?
Are you thinking of a
--verbose-browser
option?Comment #2
boombatower CreditAttribution: boombatower commentedYea, --verbose-browser is a good name. I was having a hard time coming up with a good name for the flag.
The difference being that simpletest_verbose (--verbose-browser) controls the internal browser collecting, saving, and outputting links to the page output from each request. Whereas --verbose simply prints the messages that are already being collected...it just is "more verbose" in it's output to the user.
They seem to do fairly different things (although, --verbose-browsers should require --verbose) and only one has a performance hit it seems like they should be separate flags, but if so then --verbose-browser should probably automatically enable --verbose flag for simplicity and ease-of-use.
Comment #3
sun#1705748: Convert simpletest settings to configuration system landed, so this can/could be done.
Comment #4
boombatower CreditAttribution: boombatower commentedThere seems to be a misunderstanding as there is currently _NO_ way to trigger browser verbosity through a flag...which was my point in the other issue and why the testbot cannot control this given our new approach
Comment #5
boombatower CreditAttribution: boombatower commentedAfter some confusion summarized http://drupal.org/node/1705748#comment-6435582
The documentation needs to be fixed, which we can do when we split the flag or just fix docs if we choose not to.
Before http://drupal.org/node/1719530#comment-6326150 (adding --keep-results flag issue) that was correct. After adding it now also triggers the collection of browser requests (something that is/was a separate feature not controlled by the flag before).
The change did not simply allow a variable to be overridden using the flag it added meaning to the flag which never controlled the functionality of the variable before. These should probably have been split out into separate issues so things didn't get so confused.
Comment #6
boombatower CreditAttribution: boombatower commentedI have not tested this.
Comment #7
sunLooks good to me.
I think we also want to update simpletest.module's config setting key from 'verbose' to 'verbose_browser'.
Comment #8
boombatower CreditAttribution: boombatower commentedsounds like a reasonable addition
Comment #9
boombatower CreditAttribution: boombatower commentedHow about adding --print-assertions which is probably better since $verbose can be used for other things and seems more accurate since we simply print assertions which isn't really a normal definition of verbose.
Comment #10
sunUgh, no please not. --verbose is clear. Let's get back to the previous patch, do the adjustment in #7, and be done with it.
Comment #11
boombatower CreditAttribution: boombatower commentedhmm, I mean not like we call the assertions in web interface verbose. Seems like we would need to change the assertions with link text of verbose and the directory to verbose_browser...etc to be consistent, vs verbose being used to be literally verbose things such as browser dumps and something else to print assertions.
Seems like if we want to correctly fix and still use two verbose flags we need to make a lot of other changes some of which don't make a whole lot of sense which is what led me to change directions.
Comment #12
alexpottThe patch attached implements --verbose-browser flag and allows the run-tests.sh to override whatever is set in the simpletest.settings using this flag. The --verbose flag in run-tests.sh is only for printing the results of test assertions.
Comment #13
ianthomas_uk"verbose browser" to me sounds like a tool to browse verbose output.
"capture browser" makes more sense to me, or perhaps "capture HTML" (not that it will always be HTML).
Comment #14
jhedstromComment #15
gaurav_varshney CreditAttribution: gaurav_varshney commentedUpdated patch for drupal 8.0.0-beta4
Comment #16
pwieck CreditAttribution: pwieck commentedComment #27
quietone CreditAttribution: quietone as a volunteer commentedTriaging issues in simpletest.module as part of the Bug Smash Initiative to determine if they should be in the Simpletest Project or core.
This looks like it belongs in the Simpletest project.