Comment 16 for bug 1324455

FWIW I disagree with the change that was made for this bug. The net effect is that bugs that were being discovered automatically, and might happen quite frequently under test, are now hidden from view of the developers - and yet internally, developers are still being asked to fix the bugs found by automated tests.

Every crash that's found in autotesting is a real crash. Particularly while the real userbase of the phone is small, it's important to surface all of these crashes even if they've only ever been seen in the lab. If the crashes seen in the lab are skewing the statistics, there's one sure-fire way to correct this: drive the number of crashes in the lab down to zero!

Also, while the automated tests may skew the crash counts overall, one place where they shouldn't be skewing is on the per-image / per-rootfs counts - because each combination is usually only tested once, or a small number of times. So including automated tests in these counts will provide a much better indicator of image quality than omitting them.