Merge lp:~toykeeper/qakit/add-pt-to-html into lp:qakit

[Selene ToyKeeper]

Added a PractiTest suite exporter for easy viewing of cases.

Added a PractiTest suite exporter for easy viewing of cases.

[Selene ToyKeeper (toykeeper)]

Probably not ready for actual merging yet, but it does function.
Mostly needs cleanup.

[lp:~toykeeper/qakit/add-pt-to-html]

12. By Selene ToyKeeper on 2015-05-19

Made details much wider (is its own table row, made some code more complex),
made entire row clickable to expand/collapse details,
made search filter each word individually,
added expand/collapse all links.

13. By Selene ToyKeeper on 2015-05-19

Added -r / --regenerate CLI option.
PT can only export every 2 hours, so it helps to be able to control
whether the export is re-requested or not.

14. By Selene ToyKeeper on 2015-05-19

Added support for new test suite schema. Choose a schema based on project ID.
Added a count of matching tests in current view.

15. By Selene ToyKeeper on 2015-05-19

Fixed pep8 lint complaints.
(except for the ones relating to vim's indent settings
 and commented-out lines of code)

16. By Selene ToyKeeper on 2015-05-20

Small bug fix in filter function; could match strings which spanned multiple html tags.
Allowed linewrap in "domain" column.
Minor code cleaning.

17. By Selene ToyKeeper on 2015-05-20

Added a script to export all current PT projects.

18. By Selene ToyKeeper on 2015-05-20

Ensure row colors will still alternate after a search.

[Allan LeSage (allanlesage)]

This is big! I'm looking through but will need a more thorough review than I'm able to give presently.

[Selene ToyKeeper (toykeeper)]

It might help to first merge bzr+ssh://bazaar.launchpad.net/~allanlesage/qakit/qakit/ , which this was branched from. The diff should then become smaller and easier to read.

[Max Brustkern (nuclearbob)]

I'm not sure how to do it, but if you set that branch as a prerequisite, it'll only show the new diff.

[Brendan Donegan (brendan-donegan)]

You need to resubmit the MP and can specify the prerequisite there

On Fri, May 22, 2015 at 10:17 PM, Max Brustkern <<email address hidden>
> wrote:

> I'm not sure how to do it, but if you set that branch as a prerequisite,
> it'll only show the new diff.
> --
> https://code.launchpad.net/~toykeeper/qakit/add-pt-to-html/+merge/259446
> Your team Canonical Platform QA Team is requested to review the proposed
> merge of lp:~toykeeper/qakit/add-pt-to-html into lp:qakit.
>

[lp:~toykeeper/qakit/add-pt-to-html]

19. By Selene ToyKeeper on 2015-05-29

Added ability to filter during conversion, and to dump external IDs.
Made it easier to filter client-side html by automated status.

20. By Selene ToyKeeper on 2015-05-29

Renamed pt-to-html to pt-export.

21. By Selene ToyKeeper on 2015-08-10

merged updates from trunk

Unmerged revisions

21. By Selene ToyKeeper on 2015-08-10

merged updates from trunk

20. By Selene ToyKeeper on 2015-05-29

Renamed pt-to-html to pt-export.

19. By Selene ToyKeeper on 2015-05-29

Added ability to filter during conversion, and to dump external IDs.
Made it easier to filter client-side html by automated status.

18. By Selene ToyKeeper on 2015-05-20

Ensure row colors will still alternate after a search.

17. By Selene ToyKeeper on 2015-05-20

Added a script to export all current PT projects.

16. By Selene ToyKeeper on 2015-05-20

Small bug fix in filter function; could match strings which spanned multiple html tags.
Allowed linewrap in "domain" column.
Minor code cleaning.

15. By Selene ToyKeeper on 2015-05-19

Fixed pep8 lint complaints.
(except for the ones relating to vim's indent settings
 and commented-out lines of code)

14. By Selene ToyKeeper on 2015-05-19

Added support for new test suite schema. Choose a schema based on project ID.
Added a count of matching tests in current view.

13. By Selene ToyKeeper on 2015-05-19

Added -r / --regenerate CLI option.
PT can only export every 2 hours, so it helps to be able to control
whether the export is re-requested or not.

12. By Selene ToyKeeper on 2015-05-19

Made details much wider (is its own table row, made some code more complex),
made entire row clickable to expand/collapse details,
made search filter each word individually,
added expand/collapse all links.

=== added file 'qakit/practitest/all-suites.sh'
--- qakit/practitest/all-suites.sh	1970-01-01 00:00:00 +0000
+++ qakit/practitest/all-suites.sh	2015-08-10 20:32:55 +0000
@@ -0,0 +1,9 @@
+#!/bin/sh
+
+# LANG is required to avoid python unicode issues
+export LANG=en_US.UTF-8
+export PYTHONPATH=../..
+for suite in 1294 1548 ; do
+  perl -i.old -pe 's/^(PRACTITEST_PROJECT_ID) = (\d+)/$1 = '$suite'/;' config.ini
+  ./pt-export.py $* -o /tmp/$suite.html
+done

=== modified file 'qakit/practitest/practitest.py'
--- qakit/practitest/practitest.py	2015-06-30 14:44:59 +0000
+++ qakit/practitest/practitest.py	2015-08-10 20:32:55 +0000
@@ -17,7 +17,11 @@
 
 import json
 import logging
+import os
 import requests
+import subprocess
+import time
+import xlrd
 
 from pprint import pformat
 
@@ -324,3 +328,125 @@
         logging.debug(pformat(result))
         logging.info('Updating issue pt:{} / lp:{}'.format(ptid, lpid))
         return self._put(url, data=result)
+
+    def request_export(self, entity='Step'):
+        """Ask the server to queue an export for all data of one type.
+
+        Will create a list of Issues, Tests , TestSets, Requirements or Steps, 
+        in a CSV format, to be able to export these entities to a regular 
+        spreadsheet. The method will put the export in the queue, and usually 
+        within couple of minutes it's ready to download.
+
+        Parameters:
+        :param entity: one of the following: 'Issue', 'Test', 'TestSet', 
+            'Requirement', 'Step'
+
+        Returns the following:
+        id: the id of the export - a reference to receive the output,
+        hours_gap: the # of hours until the user can re-create the same report
+        hours_to_delete: the # of hours until the system will auto-delete this 
+            file
+        """
+        #print('request_export(%s)' % (entity))
+        url = 'https://prod.practitest.com/api/exporter.json'
+        data = dict(project_id=self.project_id, entity=entity)
+        val = self._post(url, data).json()
+        if 'error' in val:
+            raise ValueError(val['error'])
+        return val
+
+    def poll_export(self, id_):
+        """Will check the status of a requested export.
+        Parameters:
+        :param id_: from the request_export method above
+
+        Returns:
+        id: the id of this export,
+        updated_at: the time it was updated
+        status: the of this export (In Queue, working, completed),
+        in_progress: true if it's not completed,
+        url: the location to take the file from (via wget or curl)
+        """
+        print('poll_export(%s)' % (id_))
+        url = 'https://prod.practitest.com/api/exporter/%s.json' % (id_)
+        val = self._get(url).json()
+        return val
+
+    def get_completed_export(self, url):
+        """Download a completed export file and return its local filesystem path.
+        """
+        save_path = '/tmp/export.%s' % (time.strftime('%Y-%m-%d_%H:%M:%S'))
+        #print('get_completed_export(%s) -> %s' % (url, save_path))
+        cmd = ('wget', '-o', '/dev/null', '-O', save_path, url)
+        subprocess.check_call(cmd)
+        # PT sends a .xslx in a .zip file  :(
+        unzipped_dir = '%s.d' % (save_path)
+        if not os.path.exists(unzipped_dir): os.makedirs(unzipped_dir)
+        prev_dir = os.getcwd()
+        os.chdir(unzipped_dir)
+        cmd = ('unzip', save_path)
+        subprocess.check_call(cmd)
+        os.chdir(prev_dir)
+        # find the unzipped .xlsx file
+        matches = [x for x in os.listdir(unzipped_dir) if x.endswith('.xlsx')]
+        if len(matches) != 1:
+            raise ValueError('PT export file had unexpected contents.')
+        xlsx_path = os.path.join(unzipped_dir, matches[0])
+        #print('get_completed_export() done')
+        return xlsx_path
+
+    def load_csv_export(self, path):
+        """Load a .csv export file saved by get_completed_export().
+        """
+        #print('load_csv_export(%s)' % (path))
+        wb = xlrd.open_workbook(path)
+        names = wb.sheet_names()
+        if len(names) != 1:
+            raise ValueError('XLSX sheet layout not as expected')
+        sheet = wb.sheet_by_index(0)
+        return sheet
+
+    def request_and_wait_for_exports(self, entities=None, ids=None):
+        #print('request_and_wait_for_exports(): %s' % (', '.join(entities)))
+        if not entities: entities=[]
+        if not ids: ids=[]
+
+        requested = []
+        for i, entity in enumerate(entities):
+            if len(ids) > i: # already downloaded, ID known
+                continue
+            d = dict(done=False, entity=entity)
+            j = self.request_export(entity)
+            print(j)
+            for f in ('id', 'hours_gap', 'hours_to_delete'):
+                d[f] = j[f]
+                #print('request_export(%s): %s=%s' % (entity, f, d[f]))
+            requested.append(d)
+
+        for i, id_ in enumerate(ids):
+            if len(entities) > i: # already downloaded, ID known
+                entity = entities[i]
+            else:
+                entity = 'unknown'
+            d = dict(done=False, id=id_, entity=entity)
+            requested.append(d)
+
+        while True:
+            for d in requested:
+                if not d['done']:
+                    j = self.poll_export(d['id'])
+                    for f in ('updated_at', 'status', 'in_progress', 'url'):
+                        d[f] = j[f]
+                        print('poll_export(%s): %s=%s' % (d['id'], f, d[f]))
+                    print('request_and_wait_for_export(%s): id=%s, status=%s'
+                            % (d['entity'], d['id'], d['status']))
+                    if not d['in_progress']:
+                        d['saved_path'] = self.get_completed_export(d['url'])
+                        d['data'] = self.load_csv_export(d['saved_path'])
+                        d['done'] = True
+
+            done = all([d['done'] for d in requested])
+            if done: break
+            time.sleep(5)
+
+        return requested

=== added file 'qakit/practitest/pt-export.py'
--- qakit/practitest/pt-export.py	1970-01-01 00:00:00 +0000
+++ qakit/practitest/pt-export.py	2015-08-10 20:32:55 +0000
@@ -0,0 +1,495 @@
+#!/usr/bin/env python3
+
+# Export PractiTest data to HTML for viewing without an account
+
+# Copyright (C) 2015 Canonical
+#
+# Author: Selene Scriven
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+import configparser
+import os
+import sys
+
+import practitest
+
+#from pprint import pprint
+
+cfg = None
+
+
+def main(args):
+    """pt-export: Export PractiTest data to plain HTML.
+    Usage: pt-export [options] [filters]
+      -h  --help        Show this help message and exit
+      -c  --cfg PATH    Read config from PATH (default: config.ini)
+      -o  --out PATH    Write output to PATH
+      -r  --regenerate  Ask PT for a new export instead of previous one.
+          --dump-extid  Export external IDs in a tab-separated format.
+
+    Filters can be any of the following:  (values are not case sensitive)
+      Column=value        Require test column to have an exact value.
+      Column like value   Require value to be somewhere in test column.
+      any=value           Require at least one column to have an exact value.
+      any like value      Require at least one column to contain value.
+      value               Same as 'any like value'.
+    """
+    global cfg
+    cfg_path = 'config.ini'
+    out_path = ''
+    out_fmt = 'html'
+    regenerate = False
+    filters = []
+
+    # Very simple CLI, nothing fancy needed
+    i = 0
+    while i < len(args):
+        a = args[i]
+        if a in ('-h', '--help'):
+            return usage()
+        elif a in ('-c', '--cfg', '--config'):
+            i += 1
+            cfg_path = args[i]
+        elif a in ('-o', '--out'):
+            i += 1
+            out_path = args[i]
+        elif a in ('-r', '--regenerate'):
+            regenerate = True
+        elif a in ('--dump-extid',):
+            out_fmt = 'extid'
+        elif a in ('-u', '--force-unicode'):
+            # TODO: Find a way to force UTF-8 for all I/O instead of ascii
+            #os.environ['LANG'] = 'en_US.UTF-8'
+            # Instead, run the script like this:
+            # LANG=en_US.UTF-8 ./pt-export.py
+            pass
+        else:
+            #return usage()
+            filters.append(a)
+        i += 1
+
+    cfg = read_config(cfg_path)
+    if cfg['practitest_project_id'] not in ('1294', '1548'):
+        raise ValueError('Unknown project ID: %s'
+                % (cfg['practitest_project_id']))
+    PT = practitest.PractitestSession(
+            cfg['practitest_project_id'],
+            cfg['practitest_api_key'],
+            cfg['practitest_api_secret_key'],
+            cfg['practitest_user_email'])
+
+    export_file(PT, out_path, regenerate, out_fmt, filters)
+
+
+def usage():
+    print(main.__doc__)
+
+
+def export_file(PT, out_path, regenerate, out_fmt, filters):
+    global cfg
+
+    print('Downloading tests...')
+    if regenerate:
+        exports = PT.request_and_wait_for_exports(entities=['Test'])
+    else:
+        if cfg['practitest_project_id'] == '1294':
+            exports = PT.request_and_wait_for_exports(entities=['Test'],
+                    ids=[41])
+        elif cfg['practitest_project_id'] == '1548':
+            exports = PT.request_and_wait_for_exports(entities=['Test'],
+                    ids=[330])
+
+    # So, PT includes steps in 'Test' export, even though steps aren't
+    # in the Test API...  not necessary to load 'Step' export too.
+    tests = exports[0]['data']
+
+    print('Parsing tests...')
+    tests = interpret_test_sheet(tests)
+
+    print('Filtering tests...')
+    tests = filter_tests(tests, filters)
+
+    print('Formatting tests...')
+    if out_fmt == 'html':
+        lines = exported_tests_to_html(tests)
+    elif out_fmt == 'extid':
+        lines = dump_extid(tests)
+    else:
+        raise ValueError('Unknown output format: %s' % out_fmt)
+
+    print('Saving...')
+    if out_path:
+        open(out_path, 'w').writelines(lines)
+
+
+def filter_tests(tests, filters):
+    """Interpret a list of filters, apply them to tests, return all matches.
+    Return all tests by default.
+    Filters are a list in any of the following formats:
+        Column=value
+        Column like value
+        value
+    The 'Column' part may be 'any' to match all columns.
+    The plain 'value' format translates to 'any like value'.
+    """
+
+    if not filters: return tests
+
+    # First, interpret the filters
+    parsed_filters = []
+    for f in filters:
+        if '=' in f:
+            left, right = f.split('=')
+            right = right.lower()
+            parsed_filters.append(('=', left, right))
+        elif ' like ' in f:
+            left, right = f.split(' like ')
+            right = right.lower()
+            parsed_filters.append(('like', left, right))
+        else:
+            parsed_filters.append(('like', 'any', f))
+
+    # Apply the filters
+    filtered = []
+    for test in tests:
+        match = True
+
+        for type_, key, needle in parsed_filters:
+            values = []
+            if key == 'any':
+                for key in test:
+                    values.append(str(test[key]).lower())
+            else:
+                if key not in test:
+                    match = False
+                    continue
+                val = str(test[key]).lower()
+                values = [val]
+
+            found = False
+            for val in values:
+                if type_ == '=':
+                    if val == needle:
+                        found = True
+                elif type_ == 'like':
+                    if needle in val:
+                        found = True
+            if not found:
+                match = False
+
+        if match:
+            filtered.append(test)
+
+    return filtered
+
+
+def dump_extid(tests):
+    """Make a report of test ID, external test ID, and test name
+    (in a tab-separated format, nulls will be represented as '-')
+    """
+    lines = []
+    columns = ('id', 'External ID', 'Name')
+    for t in tests:
+        fields = []
+        for c in columns:
+            v = str(t[c])
+            if not v: v = '-'
+            fields.append(v)
+        line = '\t'.join(fields) + '\n'
+        lines.append(line)
+
+    return lines
+
+
+def interpret_test_sheet(tests):
+    """Convert the PT xlsx export into a usable object tree.
+    The input file is an awkward cross between a database and a spreadsheet,
+    with related tables (Steps) broken out into an embedded sheet rectangle
+    for each parent object...  so it's a little awkward.
+    """
+
+    # pull column names from sheet
+    # save it into a format of test_columns[title] = (index, conversion func)
+    test_columns = dict()
+    columns = tests.row_values(0)
+    for i, c in enumerate(columns):
+        #print('col %i: %s' % (i, c))
+        test_columns[c] = [i, str]
+
+    def int_or_none(x):
+        if x == '':
+            return None
+        else:
+            return int(x)
+
+    # convert non-string columns
+    test_columns['id'][1] = int_or_none
+    test_columns['Step position'][1] = int_or_none
+
+    def tests_with_steps(tests):
+        merged = []
+        for i in range(1, tests.nrows):
+            row = tests.row_values(i)
+            rowlen = tests.row_len(i)
+
+            # is this is a continuation of the previous row?
+            if row[0]:
+                t = dict()
+                merged.append(t)
+                t['steps'] = []  # start with no test steps
+                child = False
+            else:
+                t = merged[-1]
+                child = True
+
+            step = dict()
+            for name, (col, func) in test_columns.items():
+                # skip empty child cells
+                if child and not row[col]:
+                    continue
+                try:
+                    val = func(row[col])
+                except Exception as e:
+                    print('Warn: row %i conversion error: %s' % (i, str(e)))
+                    val = row[col]
+                if name.startswith('Step '):
+                    step[name] = val
+                else:
+                    if child:
+                        t[name] = t[name] + '\n' + val
+                    else:
+                        t[name] = val
+            if ('Step position' in step) \
+                    and (step['Step position'] is not None):
+                        t['steps'].append(step)
+
+            #print('%s: %s (%i steps)' % (t['id'], t['Name'], len(t['steps'])))
+            #pprint(t['steps'])
+
+        return merged
+
+    all_tests = tests_with_steps(tests)
+
+    return all_tests
+
+
+def exported_tests_to_html(tests):
+
+    def cr_to_br(t):
+        return t.replace('\n', '<br />')
+
+    def nobr(t):
+        return str(t).replace(' ', '&nbsp;')
+
+    def step_field(step, key):
+        if key in step:
+            val = step[key]
+            if isinstance(val, str):
+                val = cr_to_br(val)
+            return val
+        else:
+            return ''
+
+    def fmt_steps(steps, test, tr_class):
+        fmt_steps.counter += 1
+        lines = []
+        if len(steps) > 0:
+            label = '%i&nbsp;steps' % (len(steps))
+        else:
+            label = '...'
+        lines.append('%s <br />' % (label))
+        hide_id = 'steps-%s' % (fmt_steps.counter)
+        #lines.append('''<span class="clickable" '
+        #        'onclick="toggle_display('%s')">%s</span><br />'''
+        #        % (hide_id, label))
+        lines.append('</td></tr>')
+        lines.append('<tr class="%s child"><td></td><td></td><td colspan="%s">'
+                % (tr_class, len(columns) - 2))
+
+        lines.append('<table class="steps" id="%s"><tr><td>' % (hide_id))
+
+        for extra in ['External ID', 'Description', 'Pre-requisites and setup',
+                'Whiteboard', 'Comments']:
+            val = get_field(test, extra)
+            if val and (val != 'N/A'):
+                lines.append('<b>%s</b>:<br />%s<br />'
+                        % (extra, cr_to_br(val)))
+
+        if len(steps) > 0:
+            lines.append('<b>Steps</b>:<br />')
+            lines.append('<table>')
+            lines.append('<tr>')
+            for header in ('#', '', 'desc', 'result'):
+                lines.append('<th align="left">%s</th>' % (header))
+            lines.append('</tr>')
+            i = 0
+            for step in steps:
+                i += 1
+                lines.append('<tr class="step-%s">' % (i % 2))
+                for field in ('Step position', 'Step name',
+                        'Step description', 'Step expected_results'):
+                    lines.append('<td>%s </td>' % step_field(step, field))
+                lines.append('</tr>')
+            lines.append('</table>')
+
+        lines.append('</td></tr></table>')
+        return '\n'.join(lines)
+    fmt_steps.counter = 0
+
+    def fmt_automated(x):
+        if x.lower() == 'yes': return 'automated'
+        else: return 'manual'
+
+    if cfg['practitest_project_id'] == '1294':
+        columns = [
+                ('id', 'ID', str, False),
+                ('Test Level', 'Suite', str, False),
+                ('Subsystem', 'Category', nobr, False),
+                ('Component', 'Subcat', str, False),
+                ('Name', 'Title', str, False),
+                ('Status', 'Status', str, False),
+                ('Tags', 'Tags', str, False),
+                ('Devices', 'Devices', str, False),
+                ('Release', 'Release', str, False),
+                ('Automated', 'Automated', fmt_automated, False),
+                ('steps', 'Steps', fmt_steps, True),
+                ]
+    elif cfg['practitest_project_id'] == '1548':
+        columns = [
+                ('id', 'ID', str, False),
+                ('Test Level', 'Suite', str, False),
+                ('Image Part', 'Part', str, False),
+                ('Test Domain', 'Domain', str, False),
+                ('Application', 'App', str, False),
+                ('Name', 'Title', str, False),
+                ('Status', 'Status', str, False),
+                ('Tags', 'Tags', str, False),
+                ('Devices', 'Devices', str, False),
+                ('Release', 'Release', str, False),
+                ('Automated', 'Automated', fmt_automated, False),
+                ('steps', 'Steps', fmt_steps, True),
+                ]
+
+    # Sort by various fields...
+    if cfg['practitest_project_id'] == '1294':
+        foo = [(
+            t['Test Level'] or '',
+            t['Subsystem'] or '',
+            t['Component'] or '',
+            t['id'], t) for t in tests]
+    elif cfg['practitest_project_id'] == '1548':
+        foo = [(
+            t['Test Level'] or '',
+            t['Test Domain'] or '',
+            t['Image Part'] or '',
+            t['Application'] or '',
+            t['id'], t) for t in tests]
+    foo.sort()
+    tests = [x[-1] for x in foo]
+
+    lines = []
+    lines.append('<html>')
+    lines.append('<head>')
+    lines.append('<title>All Tests</title>')
+    lines.append('<style><!--')
+    lines.append(open('style.css').read())
+    lines.append('--></style>')
+    lines.append('<script>')
+    lines.append(open('scripts.js').read())
+    lines.append('</script>')
+    lines.append('</head>')
+    lines.append('<body>')
+
+    lines.append('Filter:')
+    lines.append('<input type="search" class="light-table-filter" '
+            'name="filter-string" data-table="test-table" '
+            'placeholder="search string"></input>')
+
+    lines.append(' - ')
+    lines.append('<span id="numtests">%i</span> tests' % (len(tests)))
+    lines.append(' - ')
+    lines.append('<span class="clickable" onclick="toggle_all_steps(1)">'
+            'Expand All</span>')
+    lines.append(' - ')
+    lines.append('<span class="clickable" onclick="toggle_all_steps(0)">'
+            'Collapse All</span>')
+
+    lines.append('<hr />')
+
+    lines.append('<table id="all" class="test-table table">')
+
+    def table_header():
+        lines.append('<thead><tr>')
+        for field, title, func, full in columns:
+            lines.append('<th align="left">%s</th>' % (title))
+        lines.append('</tr></thead>')
+
+    def none_to_empty(v):
+        if v is None:
+            return ''
+        return v
+
+    def get_field(test, key):
+        if key in test:
+            return none_to_empty(test[key])
+        return None
+
+    table_header()
+    lines.append('<tbody>')
+    i = 0
+    for test in tests:
+        i += 1
+        #if (i%25) == 1:  # repeat header every 25 tests
+        #    table_header()
+        tr_class = 'tests-%s' % (i % 2)
+        hide_id = 'steps-%s' % (fmt_steps.counter + 1)
+        lines.append('''<tr class="%s" onclick="toggle_display('%s')">'''
+                % (tr_class, hide_id))
+        for field, title, func, full in columns:
+            val = get_field(test, field)
+            if full:
+                val = func(val, test, tr_class)
+            else:
+                val = func(val)
+            # the extra space here prevents a bug where
+            # a search for "emul" would match "Device</td><td>Multimedia"
+            lines.append('<td>{} </td>'.format(val))
+        lines.append('</tr>')
+
+    lines.append('</tbody>')
+    lines.append('</table>')
+
+    lines.append('</body>')
+    lines.append('</html>')
+
+    return lines
+
+
+def read_config(path, section='DEFAULT'):
+    """Get values from config.ini as a dict (env vars override file)"""
+    # Read config as dict
+    cfg = configparser.ConfigParser()
+    cfg.read(path)
+    cfg = dict(cfg[section])
+    # let env vars override config file
+    for k in cfg:
+        if k.upper() in os.environ:
+            cfg[k] = os.environ[k.upper()]
+    return cfg
+
+
+if __name__ == "__main__":
+    import sys
+    main(sys.argv[1:])

=== added file 'qakit/practitest/scripts.js'
--- qakit/practitest/scripts.js	1970-01-01 00:00:00 +0000
+++ qakit/practitest/scripts.js	2015-08-10 20:32:55 +0000
@@ -0,0 +1,97 @@
+function show(target) {
+  document.getElementById(target).style.display = 'block';
+}
+
+function hide(target) {
+  document.getElementById(target).style.display = 'none';
+}
+
+function toggle_display(target) {
+  if (document.getElementById(target).style.display == 'block') {
+    hide(target);
+  } else {
+    show(target);
+  }
+}
+
+function toggle_all_steps(expand) {
+  for (i=1; ; i++) {
+    target = "steps-" + i;
+    if (document.getElementById(target)) {
+      if (expand == 1) {
+        show(target);
+      } else if (expand == 0) {
+        hide(target);
+      } else if (expand == -1) {
+        toggle_display(target);
+      }
+    } else {
+      break;
+    }
+  }
+}
+
+(function(document) {
+    'use strict';
+
+    var LightTableFilter = (function(Arr) {
+
+        var _input;
+        var matches = 0;
+
+        function _onInputEvent(e) {
+            _input = e.target;
+            matches = 0;
+            var tables = document.getElementsByClassName(_input.getAttribute('data-table'));
+            Arr.forEach.call(tables, function(table) {
+                Arr.forEach.call(table.tBodies, function(tbody) {
+                    // rows come in pairs; main row and collapse-able details
+                    var row;
+                    for(row=0; row<tbody.rows.length; row+=2) {
+                        _filter(tbody.rows[row],tbody.rows[row+1]);
+                    }
+                });
+            });
+            document.getElementById("numtests").innerHTML = matches;
+        }
+
+        function _filter(row1,row2) {
+            var text = row1.textContent.toLowerCase()
+                + row2.textContent.toLowerCase();
+            // search for each word separately; require all words to match
+            var vals = _input.value.toLowerCase().split(' ');
+            var show = 1;
+            var i, val;
+            for(i=0; i<vals.length; i++) {
+                val = vals[i];
+                if(text.indexOf(val) < 0) { show = 0; }
+            }
+            // count how many items will be visible
+            if (show) { matches ++; }
+            // hide non-matching rows
+            row1.style.display = show ? 'table-row' : 'none';
+            row2.style.display = row1.style.display;
+            // preserve alternating row colors
+            var newclass = "tests-" + (matches%2);
+            row1.setAttribute('class', newclass);
+            row2.setAttribute('class', newclass);
+        }
+
+        return {
+            init: function() {
+                var inputs = document.getElementsByClassName('light-table-filter');
+                Arr.forEach.call(inputs, function(input) {
+                    input.oninput = _onInputEvent;
+                });
+            }
+        };
+    })(Array.prototype);
+
+    document.addEventListener('readystatechange', function() {
+        if (document.readyState === 'complete') {
+            LightTableFilter.init();
+        }
+    });
+
+})(document);
+

=== added file 'qakit/practitest/style.css'
--- qakit/practitest/style.css	1970-01-01 00:00:00 +0000
+++ qakit/practitest/style.css	2015-08-10 20:32:55 +0000
@@ -0,0 +1,50 @@
+table {
+  border: none;
+  border-collapse: collapse;
+}
+
+#all {
+}
+
+#all th {
+  background-color: #ffeedd;
+}
+
+#all td {
+  vertical-align: top;
+  padding-right: 10px;
+}
+
+.tests-0 td {
+  background-color: #eeeeee;
+}
+
+.tests-1 td {
+  background-color: #ffffff;
+}
+
+.steps {
+  display: none;
+}
+
+.steps th {
+  background-color: #ffffff;
+}
+
+.steps, .steps td {
+  border: none;
+  border-bottom: none;
+}
+
+.steps .step-0 td {
+  background-color: #dddddd;
+}
+
+.steps .step-1 td {
+  background-color: #eeeeee;
+}
+
+.clickable {
+  text-decoration: underline;
+  color: #4444cc;
+}