Merge lp:~canonical-platform-qa/ubuntu-community-testing/improved-reporting into lp:ubuntu-community-testing

[Christopher Lee]

Improved reporting for uploaded test results.

Better reporting for the uploaded results.

Reporting types included (incl. reference to the image lines in the follow up branch.)

  - [1] All application testsuite review
    -> Shows breakdown of all application and their tests (pass/skip/fail
  - [2] Singular application testsuite (same as above but shows single application (i.e. 2015.com.ubuntu.clock)
  - [3] Testsuite overview (click on an apps testsuite name to get to.)
    -> Drilldown of the testsuite incl P/S/F
  - [4] Test Drilldown (click on test name to get to this report)
    -> Lowest level to go, shows P/S/F, comments. W/ plans to linkify comments referencing bugs.

[Christopher Lee (veebers)]

These are images of the reports mentioned in the desc. of change.

[1] http://people.canonical.com/~leecj2/reporting/reporting-overview.png
[2] http://people.canonical.com/~leecj2/reporting/reporting-suite-overview.png
[3] http://people.canonical.com/~leecj2/reporting/reporting-suite-drilldown.png
[4] http://people.canonical.com/~leecj2/reporting/reporting-test-details.png

[I Ahmad (iahmad)]

I think there should be someway to see the latest test results at both testsuite and test case level.

[lp:~canonical-platform-qa/ubuntu-community-testing/improved-reporting]

50. By Christopher Lee on 2015-10-13

Added latest outcome to report.

[Christopher Lee (veebers)]

> I think there should be someway to see the latest test results at both
> testsuite and test case level.
Added this at revno 50. Images showing this:

  - testsuite details: http://people.canonical.com/~leecj2/reporting/reporting-testsuite-details-latestoutcome.png
  - test drilldown: http://people.canonical.com/~leecj2/reporting/reporting-test-drilldown-latestoutcome.png

[I Ahmad (iahmad)]

ok reporting looks good for now but it would be nice to see the date for last run, device it ran on, related bug links etc

[I Ahmad (iahmad)]

and of course the information about the image/build and a graph/chart too.

[Christopher Lee (veebers)]

@iahmad, sounds good all do-able. I would suggest getting this landed as is (well, within it's current scope) and iterate to add those additional things (with a defined scope, i.e. what does the graph/chart need to show.)

[Brendan Donegan (brendan-donegan)]

Technically speaking the part of a provider name before the : is just an FQDN, so it doesn't really make much sense on its own. Therefore I'd have the top level of reporting be the full name of the provider, breaking down into individual testplans/whitelists. For example for clock app:

2014.com.ubuntu.clock:clock-tests
-> clock-app-alarm
-> clock-app-setting
-> clock-app-stopwatch
-> clock-app-worldcity

Also the testsuite overview seems to be mixing job plainbox execution unit (pxu) file names with test plan or whitelist file names. I'd have to look at the raw data to see what the reason for this is though.

review: Needs Fixing

[Christopher Lee (veebers)]

> Technically speaking the part of a provider name before the : is just an FQDN,
> so it doesn't really make much sense on its own. Therefore I'd have the top
> level of reporting be the full name of the provider, breaking down into
> individual testplans/whitelists. For example for clock app:
>
> 2014.com.ubuntu.clock:clock-tests
> -> clock-app-alarm
> -> clock-app-setting
> -> clock-app-stopwatch
> -> clock-app-worldcity
I understand that the FQDN doesn't really make much sense in itself, but it's used here to collect the tests under a related header. For instance in your example there is no definition of 'clock-tests' (as the results come in named '2015.com.ubuntu.music::music-library/search-songs' for instance). So while it's somewhat arbitrary it allows for an overview view of all the tests.
Otherwise for the main overview there would be a _lot_ of tables (e.g. one for 2015.com.ubuntu.music::music-library and 2015.com.ubuntu.music::music-playlists).

As balloons has acked the existing reports and is really eager to see something I'm going to do the potentially rude thing and deploy this as is so we have something now and we can iterate on the specifics and improve it from there.

> Also the testsuite overview seems to be mixing job plainbox execution unit
> (pxu) file names with test plan or whitelist file names. I'd have to look at
> the raw data to see what the reason for this is though.
This is more than likely due to the example results that I've uploaded during my testing. I have a task to clear this out of the database and it should resolve the issue you're seeing. (You mention this due to the appearance of '2015.com.canonical' in the reports right?).

=== modified file 'ubuntu_pt_community/pages/pages.py'
--- ubuntu_pt_community/pages/pages.py	2015-09-17 05:31:40 +0000
+++ ubuntu_pt_community/pages/pages.py	2015-10-13 04:38:18 +0000
@@ -27,11 +27,20 @@
 
 class PageDefinition:
 
-    def __init__(self, name, route_name, route_func):
-        """Encapsulate the report view details."""
+    def __init__(self, name, route_name, route_func, display=True):
+        """Encapsulate the report view details.
+
+        :param name: Title name of the Page
+        :param route_name: Route string to use when defining the route
+        :param route_func: Function to bind to the route
+        :param display: Is this link displayable as is (i.e. not a composite
+          url)
+
+        """
         self.name = name
         self.route_name = route_name
         self.route_func = route_func
+        self.display = display
 
     @property
     def route_function_name(self):
@@ -43,16 +52,37 @@
 # them and adding routes.
 Report_Pages = [
     PageDefinition(
-        'All Results',
-        '/reports/all_results',
-        reports.view_all_results
-    ),
-
-    PageDefinition(
         'Latest Uploads',
         '/reports/latest',
         reports.view_latest_uploads
     ),
+
+    PageDefinition(
+        'All Tests Overview',
+        '/reports/overview',
+        reports.view_testsuite_overview
+    ),
+
+    PageDefinition(
+        'Testsuite Overview',
+        '/reports/overview/<app_under_test>',
+        reports.view_testsuite_overview,
+        display=False
+    ),
+
+    PageDefinition(
+        'Testsuite Overview',
+        '/reports/overview/<app_under_test>/<testsuite>',
+        reports.view_testsuite_drilldown,
+        display=False
+    ),
+
+    PageDefinition(
+        'Test Details',
+        '/reports/overview/<app_under_test>/<testsuite>/<test>',
+        reports.view_test_details,
+        display=False
+    ),
 ]
 
 
@@ -66,4 +96,5 @@
 
 def view_reports():
     """Render a simple list of links to available reports."""
-    return render_template('results/index.html', reports=Report_Pages)
+    index_reports = [report for report in Report_Pages if report.display]
+    return render_template('results/index.html', reports=index_reports)
 
=== modified file 'ubuntu_pt_community/pages/reports.py'
--- ubuntu_pt_community/pages/reports.py	2015-09-29 03:40:29 +0000
+++ ubuntu_pt_community/pages/reports.py	2015-10-13 04:38:18 +0000
@@ -19,7 +19,9 @@
 
 import json
 import logging
+import re
 from collections import (
+    Counter,
     defaultdict,
     namedtuple,
 )
@@ -30,78 +32,77 @@
 logger = logging.getLogger(__name__)
 
 
-def view_all_results():
-    """Render report displaying all uploaded testsuites with stats.
-
-    Stats displayed are number of runs, number of passes and fails and the % of
-    successful runs.
-    """
-    results_collection = db.get_results_collection()
-    all_uploads = results_collection.find()
-    simple_report_data = _get_simple_report_data(all_uploads)
-    return render_template(
-        'results/all_testsuites.html',
-        results=simple_report_data
-    )
-
-
-def _get_simple_report_data(all_uploads):
-    """Produce a list of suite results.
-
-    :param all_uploads: list of dicts containing uploaded data details.
-    :returns: a list of TestsuiteResult objects.
-    """
-    TestsuiteResult = namedtuple(
-        'TestsuiteResult',
-        ['name', 'runs', 'passes', 'fails', 'success_rate']
-    )
-
-    # all_uploads will be a list of dicts
-    # dict will have keys:
-    #   - results: a json string with the result details.
-    #   - user_email: email of the user who uploaded the results
-    #   - uploaded: a date of uploading
-    testsuites = defaultdict(list)
-    for upload in all_uploads:
-        upload_id = str(upload['_id'])
-
-        try:
-            results = _result_dict_from_document(upload)
-        except KeyError as e:
-            logger.warning(e)
-            continue
-
-        try:
-            only_tests = _get_only_testcases(results)
-        except KeyError:
-            logger.warning(
-                'Skipping {}: does not contain expected details'.format(
-                    upload_id
-                )
-            )
-            continue
-
-        for testname in only_tests:
-            # outcome will be 'pass' or 'fail'
-            try:
-                testsuites[testname].append(only_tests[testname]['outcome'])
-            except KeyError:
-                logger.error(
-                    'Testsuite has not outcome. Document ID: ',
-                    upload_id
-                )
-
-    results = []
-    for suite in testsuites:
-        runs = len(testsuites[suite])
-        passes = len([t for t in testsuites[suite] if t == 'pass'])
-        fails = runs - passes
-        success_rate = format(passes / runs * 100, '.2f')
-
-        results.append(
-            TestsuiteResult(suite, runs, passes, fails, success_rate)
-        )
-    return results
+CommentDetail = namedtuple('CommentDetail', ['date', 'comment'])
+
+
+class RunAggregator:
+    """Build up aggregate details for a testsuite/test."""
+
+    def __init__(self):
+        self.outcome_count = Counter()
+        self.comments = []
+        self._latest_outcome_date = None
+        self._latest_outcome = None
+
+    def update(self, outcome, testdate, comment=None):
+        """Update stored details for the test/testsuite.
+
+        :param outcome: String representing a test-run outcome. (Only report on
+          'pass', 'fail', 'skip'.)
+        :param testdate: Datetime for the testrun.
+        :param comment: Comment string for the test (if present). Will not be
+          stored if it is None (defaults to none).
+
+        """
+        # Not all tests will have comments (or have comments we care about).
+        self.outcome_count[outcome] += 1
+        if comment is not None and comment != "":
+            self.comments.append(CommentDetail(testdate, comment))
+
+        self._update_latest_outcome(testdate, outcome)
+
+    def _update_latest_outcome(self, testdate, outcome):
+        try:
+            if testdate > self._latest_outcome_date:
+                self._latest_outcome_date = testdate
+                self._latest_outcome = outcome
+        except TypeError:
+            # first testdate comparison
+            self._latest_outcome_date = testdate
+            self._latest_outcome = outcome
+
+    @property
+    def latest_outcome(self):
+        """Return the most recent outcome for this testcase."""
+        return self._latest_outcome
+
+    @property
+    def runs(self):
+        return sum(self.outcome_count.values())
+
+    @property
+    def passes(self):
+        return self.outcome_count['pass']
+
+    @property
+    def fails(self):
+        return self.outcome_count['fail']
+
+    @property
+    def skips(self):
+        return self.outcome_count['skip']
+
+    @property
+    def success_rate(self):
+        return format(self.passes / self.runs * 100, '.2f')
+
+    @property
+    def fail_rate(self):
+        return format(self.fails / self.runs * 100, '.2f')
+
+    @property
+    def skip_rate(self):
+        return format(self.skips / self.runs * 100, '.2f')
 
 
 def view_latest_uploads():
@@ -113,27 +114,15 @@
     # slight shim over the returned data to prepare it for presention.
     sanitised_uploads = []
     for upload in all_uploads:
+        try:
+            testsuite_details = _get_only_testcases_from_upload(upload)
+        except KeyError:
+            logger.info('Skipping upload; issue encountered')
+            continue
+
+        uploaded_testsuite_names = testsuite_details.keys()
         upload_date = upload['uploaded'].strftime('%Y-%b-%d %H:%M:%S')
         uploader_email = upload.get('user_email') or 'Anonymous'
-
-        try:
-            results = _result_dict_from_document(upload)
-        except KeyError as e:
-            logger.warning(e)
-            continue
-
-        try:
-            testsuite_details = _get_only_testcases(results)
-        except KeyError:
-            upload_id = str(upload.get('_id', 'Unknown'))
-            logger.warning(
-                'Skipping {}: does not contain expected details'.format(
-                    upload_id
-                )
-            )
-            continue
-        uploaded_testsuite_names = testsuite_details.keys()
-
         sanitised_uploads.append(
             dict(
                 upload_date=upload_date,
@@ -148,6 +137,51 @@
     )
 
 
+def view_testsuite_overview(app_under_test=None):
+    results_collection = db.get_results_collection()
+    all_uploads = results_collection.find()
+    overview_details = _get_testsuite_overview(all_uploads, app_under_test)
+
+    return render_template(
+        'results/all_testsuite_overview.html',
+        results=overview_details,
+        app_under_test=app_under_test,
+    )
+
+
+def view_testsuite_drilldown(app_under_test, testsuite):
+    results_collection = db.get_results_collection()
+    all_uploads = results_collection.find()
+    overview_details = _get_testsuite_drilldown(
+        all_uploads,
+        app_under_test,
+        testsuite
+    )
+
+    return render_template(
+        'results/testsuite_drilldown.html',
+        results=overview_details,
+        app_under_test=app_under_test,
+        testsuite=testsuite,
+    )
+
+
+def view_test_details(app_under_test, testsuite, test):
+    results_collection = db.get_results_collection()
+    all_uploads = results_collection.find()
+    test_details = _get_test_drilldown_details(
+        all_uploads, app_under_test, testsuite, test
+    )
+
+    return render_template(
+        'results/test_drilldown_details.html',
+        test_details=test_details,
+        app_under_test=app_under_test,
+        testsuite=testsuite,
+        testname=test,
+    )
+
+
 def _result_dict_from_document(upload):
     """Return a dict of result details.
 
@@ -190,3 +224,113 @@
     except KeyError:
         logger.warning('Upload details does not contain a resource_map')
         raise
+
+
+def _get_testsuite_overview(all_uploads, app_under_test=None):
+    test_result_data = defaultdict(lambda: defaultdict(RunAggregator))
+
+    for upload in all_uploads:
+        try:
+            test_cases = _get_only_testcases_from_upload(upload)
+        except KeyError:
+            logger.info('Skipping upload; issue encountered')
+            continue
+
+        for full_testsuitename, results in test_cases.items():
+            app, testsuite, testcase = _split_testsuite_id(full_testsuitename)
+            if app_under_test and app_under_test != app:
+                continue
+            outcome = results['outcome']
+            testrun_date = upload['uploaded'].strftime('%Y-%b-%d %H:%M:%S')
+            test_result_data[app][testsuite].update(outcome, testrun_date)
+
+    return test_result_data
+
+
+def _get_testsuite_drilldown(all_uploads, app_under_test, testsuite):
+    testsuite_result_data = defaultdict(RunAggregator)
+
+    for upload in all_uploads:
+        try:
+            test_cases = _get_only_testcases_from_upload(upload)
+        except KeyError:
+            logger.info('Skipping upload; issue encountered')
+            continue
+
+        testsuite_qualifier = '{app}::{testsuite}'.format(
+            app=app_under_test, testsuite=testsuite
+        )
+
+        for full_testsuitename, results in test_cases.items():
+            if not full_testsuitename.startswith(testsuite_qualifier):
+                continue
+            app, testsuite, testcase = _split_testsuite_id(full_testsuitename)
+
+            testrun_date = upload['uploaded'].strftime('%Y-%b-%d %H:%M:%S')
+            outcome = results['outcome']
+            testsuite_result_data[testcase].update(outcome, testrun_date)
+
+    return testsuite_result_data
+
+
+def _get_test_drilldown_details(all_uploads, app_under_test, testsuite, test):
+    test_details_data = RunAggregator()
+
+    for upload in all_uploads:
+        try:
+            test_cases = _get_only_testcases_from_upload(upload)
+        except KeyError:
+            logger.info('Skipping upload; issue encountered')
+            continue
+
+        test_qualifier_str = '{app}::{testsuite}/{test}'
+        required_test = test_qualifier_str.format(
+            app=app_under_test, testsuite=testsuite, test=test
+        )
+
+        for full_testsuitename, results in test_cases.items():
+            app, this_testsuite, testcase = _split_testsuite_id(
+                full_testsuitename
+            )
+
+            this_test = test_qualifier_str.format(
+                app=app, testsuite=this_testsuite, test=testcase
+            )
+
+            if this_test != required_test:
+                continue
+
+            outcome = results['outcome']
+            testrun_date = upload['uploaded'].strftime('%Y-%b-%d %H:%M:%S')
+            comment = results['comments']
+
+            test_details_data.update(outcome, testrun_date, comment)
+
+    return test_details_data
+
+
+def _split_testsuite_id(testsuite_string):
+    # Some tests will have a pt-id at the end
+    # app-under-test::testsuite/test/pt-id (pt-id optional)
+    elements = re.split('::|\/', testsuite_string)
+    # Ensure we only ever return 3 elements.
+    app, testsuite, test = elements[0:3]
+    return [app, testsuite, test]
+
+
+def _get_only_testcases_from_upload(upload):
+    upload_id = str(upload['_id'])
+    try:
+        results = _result_dict_from_document(upload)
+    except KeyError as e:
+        logger.warning(e)
+        raise
+    try:
+        return _get_only_testcases(results)
+    except KeyError:
+        logger.warning(
+            'Skipping {}: does not contain expected details'.format(
+                upload_id
+            )
+        )
+        raise
 
=== modified file 'ubuntu_pt_community/templates/base.html'
--- ubuntu_pt_community/templates/base.html	2015-09-09 05:31:37 +0000
+++ ubuntu_pt_community/templates/base.html	2015-10-13 04:38:18 +0000
@@ -14,6 +14,7 @@
   <body>
 
     <div id="content" class="container">
+      {% block nav %}{% endblock %}
       {% block content %}{% endblock %}
     </div>
 
 
=== added file 'ubuntu_pt_community/templates/results/all_testsuite_overview.html'
--- ubuntu_pt_community/templates/results/all_testsuite_overview.html	1970-01-01 00:00:00 +0000
+++ ubuntu_pt_community/templates/results/all_testsuite_overview.html	2015-10-13 04:38:18 +0000
@@ -0,0 +1,45 @@
+{% extends "results/overview_base.html" %}
+{% block title %}Testsuite Overview{% endblock %}
+
+{% block content %}
+<h1 class="page-header">Application Testsuite Overview</h1>
+
+<table class="table table-condensed table-bordered table-hover">
+  {% for app_under_test in results | sort %}
+  <tr>
+    <th colspan=6 class="info">
+      {% if results|length > 1 %}
+      <a href="{{url_for('view_testsuite_overview', app_under_test=app_under_test)}}">{{ app_under_test }}</a>
+      {% else %}
+      {{ app_under_test }}
+      {% endif %}
+
+    </th>
+  </tr>
+  <tr>
+    <th>Testsuite</th>
+    <th class="text-center">Runs</th>
+    <th class="text-center success">Pass</th>
+    <th class="text-center warning">Skip</th>
+    <th class="text-center danger">Fail</th>
+    <th class="text-center">Success Rate</th>
+  </tr>
+  {% for testsuite in results[app_under_test] | sort %}
+  <tr>
+    <td>
+      <a href="{{url_for('view_testsuite_drilldown', app_under_test=app_under_test, testsuite=testsuite)}}">{{testsuite}}</a>
+    </td>
+    <td class="text-center">{{results[app_under_test][testsuite].runs}}</td>
+    <td class="text-center success">{{results[app_under_test][testsuite].passes}}</td>
+    <td class="text-center warning">{{results[app_under_test][testsuite].skips}}</td>
+    <td class="text-center danger">{{results[app_under_test][testsuite].fails}}</td>
+    <td class="text-center">{{results[app_under_test][testsuite].success_rate}}%</td>
+  </tr>
+  {% endfor %}
+  <tr>
+    <td colspan=6>&nbsp;</td>
+  </tr>
+  {% endfor %}
+</table>
+
+{% endblock %}
 
=== removed file 'ubuntu_pt_community/templates/results/all_testsuites.html'
--- ubuntu_pt_community/templates/results/all_testsuites.html	2015-09-09 05:44:07 +0000
+++ ubuntu_pt_community/templates/results/all_testsuites.html	1970-01-01 00:00:00 +0000
@@ -1,23 +0,0 @@
-{% extends "base.html" %}
-{% block title %}All Result Details{% endblock %}
-
-{% block content %}
-<h1 class="page-header">All testsuite statistics</h1>
-
-<!-- Could probably also add a list of users/email address that have done this report. -->
-<table class="table table-striped table-bordered">
-  <tr>
-    <th>Testsuite</th>
-    <th>Total Runs</th>
-    <th>Success Rate</th>
-  </tr>
-  {% for report in results %}
-  <tr>
-    <td>{{report.name}}</td>
-    <td>{{report.runs}}</td>
-    <td>{{report.success_rate}}%</td>
-  </tr>
-  {% endfor %}
-</table>
-
-{% endblock %}
 
=== modified file 'ubuntu_pt_community/templates/results/index.html'
--- ubuntu_pt_community/templates/results/index.html	2015-09-09 05:44:07 +0000
+++ ubuntu_pt_community/templates/results/index.html	2015-10-13 04:38:18 +0000
@@ -1,7 +1,7 @@
 {% extends "base.html" %}
 {% block title %}Community Testing Reports{% endblock %}
 {% block content %}
-<h1 class="page-header">List of available reports</h1>
+<h1 class="page-header">Available reports</h1>
 <ul>
   {% for report in reports %}
   <li><a href="{{ url_for(report.route_function_name) }}">{{ report.name }}</a></li>
 
=== added file 'ubuntu_pt_community/templates/results/overview_base.html'
--- ubuntu_pt_community/templates/results/overview_base.html	1970-01-01 00:00:00 +0000
+++ ubuntu_pt_community/templates/results/overview_base.html	2015-10-13 04:38:18 +0000
@@ -0,0 +1,33 @@
+{% extends "base.html" %}
+
+{% block nav %}
+<ol class="breadcrumb">
+  {% set active = 'overview' %}
+  <li>
+    <a href="{{url_for('view_reports')}}">Reports</a>
+  </li>
+  {% if app_under_test is defined and not None and app_under_test is not none %}
+  {% set active = app_under_test %}
+  <li>
+    <a href="{{url_for('view_testsuite_overview')}}">overview</a>
+  </li>
+  {% if testsuite is defined and app_under_test is not none %}
+  {% set active = testsuite %}
+  <li>
+    <a href="{{url_for('view_testsuite_overview', app_under_test=app_under_test)}}">
+      {{app_under_test}}
+    </a>
+  </li>
+  {% if testname is defined %}
+  {% set active = testname %}
+  <li>
+    <a href="{{url_for('view_testsuite_drilldown', app_under_test=app_under_test, testsuite=testsuite)}}">
+      {{testsuite}}
+    </a>
+  </li>
+  {% endif %}
+  {% endif %}
+  {% endif %}
+  <li class="active">{{active}}</li>
+</ol>
+{% endblock %}
 
=== added file 'ubuntu_pt_community/templates/results/test_drilldown_details.html'
--- ubuntu_pt_community/templates/results/test_drilldown_details.html	1970-01-01 00:00:00 +0000
+++ ubuntu_pt_community/templates/results/test_drilldown_details.html	2015-10-13 04:38:18 +0000
@@ -0,0 +1,69 @@
+{% extends "results/overview_base.html" %}
+{% block title %}Test Details{% endblock %}
+
+{% block content %}
+<h1 class="page-header">Test Details</h1>
+
+{% set col_count = 6 %}
+{% set outcome_highlight = {'pass': 'success', 'skip': 'warning', 'fail': 'danger'} %}
+<table class="table table-condensed table-bordered table-hover">
+  <tr>
+    <th colspan={{col_count}} class="info">{{ app_under_test }}::{{ testsuite }}::{{ testname }}</th>
+  </tr>
+  <tr>
+    <th class="text-center">Runs</th>
+    <th class="text-center success">Pass</th>
+    <th class="text-center warning">Skips</th>
+    <th class="text-center danger">Fail</th>
+    <th class="text-center">Success Rate</th>
+    <th class="text-center">Latest Outcome</th>
+  </tr>
+  <tr>
+    <td class="text-center">{{test_details.runs}}</td>
+    <td class="text-center success">{{test_details.passes}}</td>
+    <td class="text-center warning">{{test_details.skips}}</td>
+    <td class="text-center danger">{{test_details.fails}}</td>
+    <td class="text-center">{{test_details.success_rate}}%</td>
+    <td class="text-center {{outcome_highlight[test_details.latest_outcome]}}">
+      {{test_details.latest_outcome|capitalize}}
+    </td>
+  </tr>
+
+  <tr>
+    <th colspan={{col_count}}>Overview</th>
+  </tr>
+  <tr class="active">
+    <td colspan={{col_count}}>
+      <div class="progress" style="margin-bottom: 0px;">
+        <div class="progress-bar progress-bar-success" style="width: {{test_details.success_rate}}%">
+          <span class="sr-only">{{test_details.success_rate}}% success rate</span>
+        </div>
+        <div class="progress-bar progress-bar-warning" style="width: {{test_details.skip_rate}}%">
+          <span class="sr-only">{{test_details.skip_rate}}% skip rate</span>
+        </div>
+        <div class="progress-bar progress-bar-danger" style="width: {{test_details.fail_rate}}%">
+          <span class="sr-only">{{test_details.fail_rate}}% fail rate</span>
+        </div>
+      </div>
+    </td>
+  </tr>
+
+  {% if test_details.comments| length > 0 %}
+  <tr>
+    <th colspan={{col_count}}>Comments</th>
+  </tr>
+  <tr class="active">
+    <td colspan={{col_count}}>
+      {% for comment in test_details.comments %}
+      <blockquote>
+        <p>{{comment.comment}}</p>
+        <footer>{{comment.date}}</footer>
+      </blockquote>
+      {% endfor %}
+    </td>
+  </tr>
+  {% endif %}
+
+</table>
+
+{% endblock %}
 
=== added file 'ubuntu_pt_community/templates/results/testsuite_drilldown.html'
--- ubuntu_pt_community/templates/results/testsuite_drilldown.html	1970-01-01 00:00:00 +0000
+++ ubuntu_pt_community/templates/results/testsuite_drilldown.html	2015-10-13 04:38:18 +0000
@@ -0,0 +1,42 @@
+{% extends "results/overview_base.html" %}
+{% block title %}Testsuite Drilldown{% endblock %}
+
+{% block content %}
+<h1 class="page-header">Testsuite Drilldown</h1>
+
+{% set col_count = 7 %}
+{% set outcome_highlight = {'pass': 'success', 'skip': 'warning', 'fail': 'danger'} %}
+<table class="table table-condensed table-bordered table-hover">
+  <tr>
+    <th colspan={{ col_count }} class="info">{{ app_under_test }}::{{ testsuite }}</th>
+  </tr>
+  <tr>
+    <th>Testsuite</th>
+    <th class="text-center">Runs</th>
+    <th class="text-center success">Pass</th>
+    <th class="text-center warning">Skip</th>
+    <th class="text-center danger">Fail</th>
+    <th class="text-center">Success Rate</th>
+    <th class="text-center">Latest Outcome</th>
+  </tr>
+  {% for test in results | sort %}
+  {% set current_test = results[test] %}
+  <tr>
+    <td>
+      <a href="{{url_for('view_test_details', app_under_test=app_under_test, testsuite=testsuite, test=test)}}">
+        {{test}}
+      </a>
+    </td>
+    <td class="text-center">{{current_test.runs}}</td>
+    <td class="text-center success">{{current_test.passes}}</td>
+    <td class="text-center warning">{{current_test.skips}}</td>
+    <td class="text-center danger">{{current_test.fails}}</td>
+    <td class="text-center">{{current_test.success_rate}}%</td>
+    <td class="text-center {{outcome_highlight[current_test.latest_outcome]}}">
+      {{current_test.latest_outcome|capitalize}}
+    </td>
+  </tr>
+
+  {% endfor %}
+</table>
+{% endblock %}