Merge ~sylvain-pineau/checkbox-ng:tp-export into checkbox-ng:master

[Sylvain Pineau]

New command line subcommand to generate test case guide based on a given test plan unit.

Example:

$ checkbox-cli tp-export com.canonical.certification::client-cert-18-04

Or to export a PDF:

$ checkbox-cli tp-export com.canonical.certification::client-cert-18-04 | xargs -d '\n' libreoffice --headless --invisible --convert-to pdf

Sample output: https://private-fileshare.canonical.com/~spineau/18.04%20Client%20Certification%20Tests.pdf

[Maciej Kisielewski (kissiel)]

I consider a bad design making the core of checkbox (JobRunner) aware of the TP export functionality and hardcoding a special case for graphics cards. If having specialised JobRunner is the best solution for the problem, let's do just that, by creating FakeJobRunner that overrides necessary parts. It could also help with the problem of propagating tp_export arg (which I would prefer renamed to exported_tp_name, tp_export misled me, but that's subjective).

I know this code does the job, but for me it has a "dirty hack" feel and voids abstractions that are already in place.

review: Needs Fixing

[Sylvain Pineau (sylvain-pineau)]

Corrected version this time using a special FakeJobRunner class. the tp name is no longer passed trough all layers, instead i'm passing a boolean flag, "fake_resources".

Tested using:

$ checkbox-cli tp-export com.canonical.certification::client-cert-18-04

$ checkbox-cli tp-export com.canonical.qa.plano::gen2

review: Needs Resubmitting

[Maciej Kisielewski (kissiel)]

I like it much more! I also sense that we may use this approach in the future for something else :)

Thank you and +1.

One thing to consider below.

review: Approve

diff --git a/checkbox_ng/launcher/checkbox_cli.py b/checkbox_ng/launcher/checkbox_cli.py
index 59202e7..8457a3f 100644
--- a/checkbox_ng/launcher/checkbox_cli.py
+++ b/checkbox_ng/launcher/checkbox_cli.py
@@ -40,7 +40,8 @@ from plainbox.impl.launcher import DefaultLauncherDefinition
 from plainbox.impl.launcher import LauncherDefinition
 
 from checkbox_ng.launcher.subcommands import (
-    Launcher, List, Run, StartProvider, Submit, ListBootstrapped
+    Launcher, List, Run, StartProvider, Submit, ListBootstrapped,
+    TestPlanExport
 )
 from checkbox_ng.launcher.check_config import CheckConfig
 from checkbox_ng.launcher.remote import RemoteSlave, RemoteMaster
@@ -161,6 +162,7 @@ class CheckboxCommand(CanonicalCommand):
         ('startprovider', StartProvider),
         ('submit', Submit),
         ('list-bootstrapped', ListBootstrapped),
+        ('tp-export', TestPlanExport),
         ('slave', RemoteSlave),
         ('master', RemoteMaster),
     )
diff --git a/checkbox_ng/launcher/subcommands.py b/checkbox_ng/launcher/subcommands.py
index cb31211..768c682 100644
--- a/checkbox_ng/launcher/subcommands.py
+++ b/checkbox_ng/launcher/subcommands.py
@@ -973,6 +973,36 @@ class ListBootstrapped(Command):
                     print(job_id)
 
 
+class TestPlanExport(Command):
+    name = 'tp-export'
+
+    @property
+    def sa(self):
+        return self.ctx.sa
+
+    def register_arguments(self, parser):
+        parser.add_argument(
+            'TEST_PLAN',
+            help=_("test-plan id to bootstrap"))
+
+    def invoked(self, ctx):
+        self.ctx = ctx
+        try_selecting_providers(self.sa, '*')
+        from plainbox.impl.runner import FakeJobRunner
+        self.sa.start_new_session('tp-export-ephemeral', FakeJobRunner)
+        self.sa._context.state._fake_resources = True
+        tps = self.sa.get_test_plans()
+        if ctx.args.TEST_PLAN not in tps:
+            raise SystemExit('Test plan not found')
+        self.sa.select_test_plan(ctx.args.TEST_PLAN)
+        self.sa.bootstrap()
+        path = self.sa.export_to_file(
+            'com.canonical.plainbox::tp-export', [],
+            self.sa._manager.storage.location,
+            self.sa._manager.test_plans[0].name)
+        print(path)
+
+
 def try_selecting_providers(sa, *args, **kwargs):
     """
     Try selecting proivders via SessionAssistant.
diff --git a/docs/using.rst b/docs/using.rst
index cee2785..0d9bccd 100644
--- a/docs/using.rst
+++ b/docs/using.rst
@@ -131,6 +131,33 @@ Similarly to the ``checkbox-cli list all-jobs`` command, the output of
 See ``checkbox-cli list`` :ref:`output-formatting` section for more information.
 
 
+checkbox-cli tp-export
+``````````````````````
+
+``tp-export`` exports a test plan as a spreadsheet document. Tests are grouped
+by categories and ordered alphabetically with the full description (or the job
+summary if there's no description). I addition to the description, the
+certification status (blocker/non-blocker) is exported.
+
+The session is similar to ``list-bootstrapped`` but all resource jobs are
+returning fake objects and template-filters are disabled to ensure
+instantiation of template units. By default only one resource object is
+returned. The only exception is the graphics_card resource where two objects are
+used to simulate hybrid graphics.
+
+The command prints the full path to the document on exit/success.
+
+Example::
+
+    $ checkbox-cli tp-export com.canonical.certification::client-cert-18-04
+
+It can be used to automatically generate a test case guide using a pdf converter:
+
+Example::
+
+    $ checkbox-cli tp-export com.canonical.certification::client-cert-18-04 | xargs -d '\n' libreoffice --headless --invisible --convert-to pdf
+
+
 checkbox-cli launcher
 `````````````````````
 
diff --git a/plainbox/impl/ctrl.py b/plainbox/impl/ctrl.py
index ef1441c..471dd5f 100644
--- a/plainbox/impl/ctrl.py
+++ b/plainbox/impl/ctrl.py
@@ -224,7 +224,8 @@ class CheckBoxSessionStateController(ISessionStateController):
                 inhibitors.append(inhibitor)
         return inhibitors
 
-    def observe_result(self, session_state, job, result):
+    def observe_result(self, session_state, job, result,
+                       fake_resources=False):
         """
         Notice the specified test result and update readiness state.
 
@@ -234,6 +235,9 @@ class CheckBoxSessionStateController(ISessionStateController):
             A JobDefinition object
         :param result:
             A IJobResult object
+        :param fake_resources:
+            An optional parameter to trigger test plan export execution mode
+            using fake resourceobjects
 
         This function updates the internal result collection with the data from
         the specified test result. Results can safely override older results.
@@ -256,15 +260,18 @@ class CheckBoxSessionStateController(ISessionStateController):
         session_state.on_job_result_changed(job, result)
         # Treat some jobs specially and interpret their output
         if job.plugin == "resource":
-            self._process_resource_result(session_state, job, result)
+            self._process_resource_result(
+                session_state, job, result, fake_resources)
 
-    def _process_resource_result(self, session_state, job, result):
+    def _process_resource_result(self, session_state, job, result,
+                                 fake_resources=False):
         """
         Analyze a result of a CheckBox "resource" job and generate
         or replace resource records.
         """
         self._parse_and_store_resource(session_state, job, result)
-        self._instantiate_templates(session_state, job, result)
+        self._instantiate_templates(
+            session_state, job, result, fake_resources)
 
     def _parse_and_store_resource(self, session_state, job, result):
         # NOTE: https://bugs.launchpad.net/checkbox/+bug/1297928
@@ -289,7 +296,8 @@ class CheckBoxSessionStateController(ISessionStateController):
         # Replace any old resources with the new resource list
         session_state.set_resource_list(job.id, new_resource_list)
 
-    def _instantiate_templates(self, session_state, job, result):
+    def _instantiate_templates(self, session_state, job, result,
+                               fake_resources=False):
         # NOTE: https://bugs.launchpad.net/checkbox/+bug/1297928
         # If we are resuming from a session that had a resource job that
         # never ran, we will see an empty MemoryJobResult object.
@@ -302,7 +310,7 @@ class CheckBoxSessionStateController(ISessionStateController):
             if isinstance(unit, TemplateUnit) and unit.resource_id == job.id:
                 logger.info(_("Instantiating unit: %s"), unit)
                 for new_unit in unit.instantiate_all(
-                        session_state.resource_map[job.id]):
+                        session_state.resource_map[job.id], fake_resources):
                     try:
                         check_result = new_unit.check()
                     except MissingParam as m:
diff --git a/plainbox/impl/exporter/xlsx.py b/plainbox/impl/exporter/xlsx.py
index 360a368..f582339 100644
--- a/plainbox/impl/exporter/xlsx.py
+++ b/plainbox/impl/exporter/xlsx.py
@@ -64,12 +64,14 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
     OPTION_WITH_SUMMARY = 'with-summary'
     OPTION_WITH_DESCRIPTION = 'with-job-description'
     OPTION_WITH_TEXT_ATTACHMENTS = 'with-text-attachments'
+    OPTION_TEST_PLAN_EXPORT = 'tp-export'
 
     SUPPORTED_OPTION_LIST = (
         OPTION_WITH_SYSTEM_INFO,
         OPTION_WITH_SUMMARY,
         OPTION_WITH_DESCRIPTION,
         OPTION_WITH_TEXT_ATTACHMENTS,
+        OPTION_TEST_PLAN_EXPORT,
     )
 
     def __init__(self, option_list=None, exporter_unit=None):
@@ -135,6 +137,10 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
             'align': 'left', 'valign': 'vcenter', 'text_wrap': 1, 'size': 8,
             'border': 1, 'bg_color': '#E6E6E6',
         })
+        self.format06_2 = self.workbook.add_format({
+            'align': 'left', 'valign': 'vcenter', 'text_wrap': 1, 'size': 8,
+            'border': 1, 'bg_color': '#E6E6E6', 'bold': 1,
+        })
         # Headlines (center)
         self.format07 = self.workbook.add_format({
             'align': 'center', 'size': 10, 'bold': 1,
@@ -385,7 +391,8 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
                     self.format08 if i % 2 else self.format09
                 )
                 self.worksheet1.set_row(
-                    packages_starting_row + i, None, None, {'level': 1, 'hidden': True}
+                    packages_starting_row + i, None, None,
+                    {'level': 1, 'hidden': True}
                 )
             self.worksheet1.set_row(
                 packages_starting_row+len(data["resource_map"][resource]),
@@ -522,11 +529,11 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
                         self.worksheet4.set_row(
                             self._lineno, 13, None, {'level': level})
                 else:
-                    self.worksheet3.set_row(self._lineno, 13, None,
-                        {'collapsed': True})
+                    self.worksheet3.set_row(
+                        self._lineno, 13, None, {'collapsed': True})
                     if self.OPTION_WITH_DESCRIPTION in self._option_list:
-                        self.worksheet4.set_row(self._lineno, 13, None,
-                            {'collapsed': True})
+                        self.worksheet4.set_row(
+                            self._lineno, 13, None, {'collapsed': True})
                 self._write_job(children, result_map, max_level, level + 1)
             else:
                 self.worksheet3.write(
@@ -604,8 +611,9 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
                             self._lineno, 12 + 10.5 * desc_lines,
                             None, {'level': level, 'hidden': True})
                 else:
-                    self.worksheet3.set_row(self._lineno, 12 + 10.5 * io_lines,
-                    None, {'hidden': True})
+                    self.worksheet3.set_row(
+                        self._lineno, 12 + 10.5 * io_lines,
+                        None, {'hidden': True})
                     if self.OPTION_WITH_DESCRIPTION in self._option_list:
                         self.worksheet4.set_row(
                             self._lineno, 12 + 10.5 * desc_lines, None,
@@ -649,6 +657,63 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
                 self._lineno + 1, None, None, {'collapsed': True})
         self.worksheet3.autofilter(5, max_level, self._lineno, max_level + 3)
 
+    def write_tp_export(self, data):
+        def _category_map(state):
+            """Map from category id to their corresponding translated names."""
+            wanted_category_ids = frozenset({
+                    job_state.effective_category_id
+                    for job_state in state.job_state_map.values()
+                    if job_state.job in state.run_list and
+                    job_state.job.plugin not in ("resource", "attachment")
+                })
+            return {
+                unit.id: unit.tr_name()
+                for unit in state.unit_list
+                if unit.Meta.name == 'category'
+                and unit.id in wanted_category_ids
+            }
+        self.worksheet4.set_header(
+            '&C{}'.format(data['manager'].test_plans[0]))
+        self.worksheet4.set_footer('&CPage &P of &N')
+        self.worksheet4.set_margins(left=0.3, right=0.3, top=0.5, bottom=0.5)
+        self.worksheet4.set_column(0, 0, 40)
+        self.worksheet4.set_column(1, 1, 13)
+        self.worksheet4.set_column(2, 2, 55)
+        self.worksheet4.write_row(
+            0, 0,
+            ['Name', 'Certification status', 'Description'], self.format06_2
+        )
+        self.worksheet4.repeat_rows(0)
+        self._lineno = 0
+        state = data['manager'].default_device_context.state
+        cat_map = _category_map(state)
+        run_list_ids = [job.id for job in state.run_list]
+        for cat_id in sorted(cat_map, key=lambda x: cat_map[x].casefold()):
+            for job_id in sorted(state._job_state_map):
+                job_state = state._job_state_map[job_id]
+                if job_id not in run_list_ids:
+                    continue
+                if (
+                    job_state.effective_category_id == cat_id and
+                    job_state.job.plugin not in ("resource", "attachment")
+                ):
+                    self._lineno += 1
+                    certification_status = \
+                        job_state.effective_certification_status
+                    if certification_status == 'unspecified':
+                        certification_status = ''
+                    description = job_state.job.description
+                    if not description:
+                        description = job_state.job.summary
+                    self.worksheet4.write_row(
+                        self._lineno, 0,
+                        [job_state.job.partial_id,
+                         certification_status, description],
+                        self.format05)
+                    desc_lines = len(description.splitlines()) + 1
+                    self.worksheet4.set_row(self._lineno, 12 * desc_lines)
+            self._lineno += 1
+
     def write_attachments(self, data):
         self.worksheet5.set_column(0, 0, 5)
         self.worksheet5.set_column(1, 1, 120)
@@ -679,7 +744,8 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
         self.worksheet6.set_column(0, 0, 5)
         self.worksheet6.set_column(1, 1, 120)
         i = 4
-        for name in [job_id for job_id in data['result_map'] if data['result_map'][job_id]['plugin'] == 'resource']:
+        for name in [job_id for job_id in data['result_map']
+                     if data['result_map'][job_id]['plugin'] == 'resource']:
             io_log = ' '
             try:
                 if data['result_map'][name]['io_log']:
@@ -704,6 +770,21 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
             self.worksheet6.set_row(i + j, None, None, {'collapsed': True})
             i += j + 1  # Insert a newline between resources logs
 
+    def dump_from_session_manager(self, session_manager, stream):
+        """
+        Extract data from session_manager and dump it into the stream.
+
+        :param session_manager:
+            SessionManager instance that manages session to be exported by
+            this exporter
+        :param stream:
+            Byte stream to write to.
+
+        """
+        data = self.get_session_data_subset(session_manager)
+        data['manager'] = session_manager
+        self.dump(data, stream)
+
     def dump(self, data, stream):
         """
         Public method to dump the XLSX report to a stream
@@ -713,19 +794,27 @@ class XLSXSessionStateExporter(SessionStateExporterBase):
         if self.OPTION_WITH_SYSTEM_INFO in self._option_list:
             self.worksheet1 = self.workbook.add_worksheet(_('System Info'))
             self.write_systeminfo(data)
-        self.worksheet3 = self.workbook.add_worksheet(_('Test Results'))
-        if self.OPTION_WITH_DESCRIPTION in self._option_list:
+        if not self.OPTION_TEST_PLAN_EXPORT:
+            self.worksheet3 = self.workbook.add_worksheet(_('Test Results'))
+        if (
+            self.OPTION_WITH_DESCRIPTION in self._option_list or
+            self.OPTION_TEST_PLAN_EXPORT in self._option_list
+        ):
             self.worksheet4 = self.workbook.add_worksheet(
                 _('Test Descriptions'))
-        self.write_results(data)
+        if self.OPTION_TEST_PLAN_EXPORT:
+            self.write_tp_export(data)
+        else:
+            self.write_results(data)
         if self.OPTION_WITH_SUMMARY in self._option_list:
             self.worksheet2 = self.workbook.add_worksheet(_('Summary'))
             self.write_summary(data)
         if self.OPTION_WITH_TEXT_ATTACHMENTS in self._option_list:
             self.worksheet5 = self.workbook.add_worksheet(_('Log Files'))
             self.write_attachments(data)
-        self.worksheet6 = self.workbook.add_worksheet(_('Resources Logs'))
-        self.write_resources(data)
+        if not self.OPTION_TEST_PLAN_EXPORT:
+            self.worksheet6 = self.workbook.add_worksheet(_('Resources Logs'))
+            self.write_resources(data)
         for worksheet in self.workbook.worksheets():
             worksheet.outline_settings(True, False, False, True)
             worksheet.hide_gridlines(2)
diff --git a/plainbox/impl/providers/exporters/units/exporter.pxu b/plainbox/impl/providers/exporters/units/exporter.pxu
index 65f96eb..c55843f 100644
--- a/plainbox/impl/providers/exporters/units/exporter.pxu
+++ b/plainbox/impl/providers/exporters/units/exporter.pxu
@@ -45,3 +45,10 @@ _summary: Generate junit XML
 entry_point: jinja2
 file_extension: junit.xml
 data: {"template": "junit.xml"}
+
+unit: exporter
+id: tp-export
+_summary: Generate an Excel 2007+ XLSX export of a test plan
+entry_point: xlsx
+file_extension: xlsx
+options: tp-export
\ No newline at end of file
diff --git a/plainbox/impl/runner.py b/plainbox/impl/runner.py
index 8adf4dc..7807a8f 100644
--- a/plainbox/impl/runner.py
+++ b/plainbox/impl/runner.py
@@ -518,6 +518,7 @@ class JobRunner(IJobRunner):
         else:
             result = self._just_run_command(
                 job, job_state, config).get_result()
+
         return result
 
     def run_manual_job(self, job, job_state, config):
@@ -970,3 +971,34 @@ class JobRunner(IJobRunner):
             logger.warning(
                 _("Please store desired files in $PLAINBOX_SESSION_SHARE and"
                   " use regular temporary files for everything else"))
+
+
+class FakeJobRunner(JobRunner):
+
+    """
+    Fake runner for jobs.
+
+    Special runner that creates fake resource objects.
+    """
+
+    def run_resource_job(self, job, job_state, config):
+        """
+        Method called to run a job with plugin field equal to 'resource'.
+
+        Only one resouce object is created from this runner.
+        Exception: 'graphics_card' resource job creates two objects to
+        simulate hybrid graphics.
+        """
+        if job.plugin != "resource":
+            # TRANSLATORS: please keep 'plugin' untranslated
+            raise ValueError(_("bad job plugin value"))
+        builder = JobResultBuilder()
+        if job.partial_id == 'graphics_card':
+            builder.io_log = [(0, 'stdout', b'a: b\n'),
+                              (1, 'stdout', b'\n'),
+                              (2, 'stdout', b'a: c\n')]
+        else:
+            builder.io_log = [(0, 'stdout', b'a: b\n')]
+        builder.outcome = 'pass'
+        builder.return_code = 0
+        return builder.get_result()
diff --git a/plainbox/impl/session/assistant.py b/plainbox/impl/session/assistant.py
index 9470905..995e38b 100644
--- a/plainbox/impl/session/assistant.py
+++ b/plainbox/impl/session/assistant.py
@@ -551,7 +551,7 @@ class SessionAssistant:
                 storage.remove()
 
     @raises(UnexpectedMethodCall)
-    def start_new_session(self, title: str):
+    def start_new_session(self, title: str, runner_cls=JobRunner):
         """
         Create a new testing session.
 
@@ -588,7 +588,7 @@ class SessionAssistant:
         self._metadata.flags = {'bootstrapping'}
         self._manager.checkpoint()
         self._command_io_delegate = JobRunnerUIDelegate(_SilentUI())
-        self._init_runner()
+        self._init_runner(runner_cls)
         self.session_available(self._manager.storage.id)
         _logger.debug("New session created: %s", title)
         UsageExpectation.of(self).allowed_calls = {
@@ -1541,7 +1541,8 @@ class SessionAssistant:
 
     @raises(KeyError, OSError)
     def export_to_file(
-        self, exporter_id: str, option_list: 'list[str]', dir_path: str
+        self, exporter_id: str, option_list: 'list[str]', dir_path: str,
+        filename: str=None
     ) -> str:
         """
         Export the session to file using given exporter ID.
@@ -1556,6 +1557,9 @@ class SessionAssistant:
         :param dir_path:
             Path to the directory where session file should be written to.
             Note that the file name is automatically generated, based on
+        :param filename:
+            Optional file name (without extension)
+            By default, the file name is automatically generated, based on
             creation time and type of exporter.
         :returns:
             Path to the written file.
@@ -1572,8 +1576,11 @@ class SessionAssistant:
         # issues when copying files.
         isoformat = "%Y-%m-%dT%H.%M.%S.%f"
         timestamp = datetime.datetime.utcnow().strftime(isoformat)
+        basename = 'submission_' + timestamp
+        if filename:
+            basename = filename
         path = os.path.join(dir_path, ''.join(
-            ['submission_', timestamp, '.', exporter.unit.file_extension]))
+            [basename, '.', exporter.unit.file_extension]))
         with open(path, 'wb') as stream:
             exporter.dump_from_session_manager(self._manager, stream)
         return path
@@ -1663,12 +1670,12 @@ class SessionAssistant:
             self.finish_bootstrap: "to finish bootstrapping",
         }
 
-    def _init_runner(self):
+    def _init_runner(self, runner_cls):
         self._execution_ctrl_list = []
         for ctrl_cls, args, kwargs in self._ctrl_setup_list:
             self._execution_ctrl_list.append(
                 ctrl_cls(self._context.provider_list, *args, **kwargs))
-        self._runner = JobRunner(
+        self._runner = runner_cls(
             self._manager.storage.location,
             self._context.provider_list,
             jobs_io_log_dir=os.path.join(
diff --git a/plainbox/impl/session/state.py b/plainbox/impl/session/state.py
index 9360f91..9dfc15a 100644
--- a/plainbox/impl/session/state.py
+++ b/plainbox/impl/session/state.py
@@ -799,6 +799,7 @@ class SessionState:
         self._mandatory_job_list = []
         self._run_list = []
         self._resource_map = {}
+        self._fake_resources = False
         self._metadata = SessionMetaData()
         super(SessionState, self).__init__()
 
@@ -998,7 +999,8 @@ class SessionState:
         any old entries), with a list of the resources that were parsed from
         the IO log.
         """
-        job.controller.observe_result(self, job, result)
+        job.controller.observe_result(
+            self, job, result, fake_resources=self._fake_resources)
         self._recompute_job_readiness()
 
     @deprecated('0.9', 'use the add_unit() method instead')
@@ -1100,7 +1102,7 @@ class SessionState:
         else:
             # If there is a clash report DependencyDuplicateError only when the
             # hashes are different.
-            if new_job != existing_job:
+            if new_job != existing_job and not self._fake_resources:
                 raise DependencyDuplicateError(existing_job, new_job)
             self._add_job_siblings_unit(new_job, recompute, via)
             return existing_job
diff --git a/plainbox/impl/unit/template.py b/plainbox/impl/unit/template.py
index 6e8a810..1103a76 100644
--- a/plainbox/impl/unit/template.py
+++ b/plainbox/impl/unit/template.py
@@ -139,6 +139,7 @@ class TemplateUnit(Unit):
         super().__init__(
             data, raw_data, origin, provider, parameters, field_offset_map)
         self._filter_program = None
+        self._fake_resources = False
 
     @classmethod
     def instantiate_template(cls, data, raw_data, origin, provider, parameters,
@@ -302,7 +303,7 @@ class TemplateUnit(Unit):
         all_units.load()
         return all_units.get_by_name(self.template_unit).plugin_object
 
-    def instantiate_all(self, resource_list):
+    def instantiate_all(self, resource_list, fake_resources=False):
         """
         Instantiate a list of job definitions.
 
@@ -311,12 +312,15 @@ class TemplateUnit(Unit):
         :param resource_list:
             A list of resource objects with the correct name
             (:meth:`template_resource`)
+        :param fake_resources:
+            An optional parameter to trigger test plan export execution mode
         :returns:
             A list of new Unit (or subclass) objects.
         """
         unit_cls = self.get_target_unit_cls()
         resources = []
         index = 0
+        self._fake_resources = fake_resources
         for resource in resource_list:
             if self.should_instantiate(resource):
                 index += 1
@@ -380,6 +384,13 @@ class TemplateUnit(Unit):
         # See https://bugs.launchpad.net/bugs/1561821
         parameters = {
             k: v for k, v in parameters.items() if k in accessed_parameters}
+        if self._fake_resources:
+            parameters = {k: k.upper() for k in accessed_parameters}
+            for k in parameters:
+                if k.endswith('_slug'):
+                    parameters[k] = k.replace('_slug', '').upper()
+            if 'index' in parameters:
+                parameters['index'] = index
         # Add the special __index__ to the resource namespace variables
         parameters['__index__'] = index
         # Instantiate the class using the instantiation API
@@ -401,6 +412,8 @@ class TemplateUnit(Unit):
         specified resource object would make the filter program evaluate to
         True.
         """
+        if self._fake_resources:
+            return True
         program = self.get_filter_program()
         if program is None:
             return True