lp:~sylvain-pineau/checkbox-ng

Author: Sylvain Pineau
Author Date: 2023-07-06 11:17:49 UTC

scm fixes

Author: Sylvain Pineau
Author Date: 2022-10-04 15:32:11 UTC

requirements: Install python3-tqdm from checkbox-dev/ppa

Author: Sylvain Pineau
Author Date: 2022-10-04 11:37:56 UTC

Add tqdm to the pip requirements

Author: Sylvain Pineau
Author Date: 2022-06-02 09:38:07 UTC

remote_assistant: Also check for XDG_SESSION_TYPE in processes environ dict

Running processes having DISPLAY set in their environment does not necessarily
imply XDG_SESSION_TYPE is set as well.

This patch only selects processes having DISPLAY, XAUTHORITY and XDG_SESSION_TYPE
to populate the extra env dict.

Fixes: lp:1972946

Author: Sylvain Pineau
Author Date: 2022-05-02 16:07:44 UTC

plainbox:execution: Run job commands using the unconfined profile on UC

Author: Sylvain Pineau
Author Date: 2022-04-14 15:15:26 UTC

Revert "Merge #419398 from ~kissiel/checkbox-ng:remote-api-bump"

This reverts commit c8d2052ff8321592d25534bafc5f364757de9195, reversing
changes made to 47229249ed71df88e7c8c0f9feec054fb60be4d9.

Author: Sylvain Pineau
Author Date: 2022-03-31 12:29:02 UTC

remote:assistant: Add XDG_SESSION_TYPE to the extra_env

The checkbox service running as root inherits session environment variables
from the user who started the desktop session.

Graphic jobs now needs XDG_SESSION_TYPE to identify Gnome vs Wayland sessions.

Author: Sylvain Pineau
Author Date: 2022-03-30 18:08:22 UTC

session:assistant: Fix the detect_restart_strategy by looking into app_blob

The session title is not a reliable way to evaluate the session type.
By default launchers set the title to 'session title'.
This patch extract that information from the session metadata app blob.

Author: Sylvain Pineau
Author Date: 2022-03-21 12:03:34 UTC

restart.py: Check for RemoteDebRestartStrategy support first

Due to snapd CVE-2021-44731, the checkbox remote service now runs outside
confinement but fakes env var like SNAP and SNAP_DATA.

The auto detection mechanism must check the RemoteDebRestartStrategy first
because the new systemd service is also named checkbox-ng.service like for
debian packages.

Sharing the same restart strategy logic as debs can only work if the code
using on_ubuntucore() is never reached in this use case.

Author: Sylvain Pineau
Author Date: 2022-02-11 17:16:27 UTC

mini-me: new checkbox-cli command

The "remote" version of the "local" `checkbox-cli run` command.

Supported pattern:
- Only a single job id is supported
- Only automated tests, no manual or semi-auto plugins
- Test plan ids are rejected

Selection of the target host:
- Target machine IP can be provided with either --host or the env var TARGET_HOST

Standard streams
- Remote stdout/stderr are printed locally on the the same local streams
- No colorizer

Session management:
- Ephemeral sessions on service side, removed after job execution
- launcher settings are transferred to the TARGET_HOST

Author: Ubuntu
Author Date: 2022-01-24 14:20:21 UTC

Merge #411951 from ~kissiel/checkbox-ng:fix-provider-develop

Author: Sylvain Pineau
Author Date: 2021-11-19 13:43:42 UTC

Change: nested parts not found are now failing validation

test plan ids not found while performing a validation in context are now
causing the ./manage.py validate command to fail.
(instead of just logging warnings).

Author: Jenkins
Author Date: 2021-11-08 12:56:57 UTC

Bump to v1.15.0rc1

Author: Sylvain Pineau
Author Date: 2021-05-16 09:11:07 UTC

exporters:multi-page.html: Fix the dropdown list default selected item

When more than 10 SKUS are grouped in a single report, the select default
value is wrong for items >10 since the corresponding js was only taking
the last digit. Fixed by just using the jinja loop index.

Author: Sylvain Pineau
Author Date: 2021-05-06 16:11:37 UTC

session:restart.py: Fix the XDG strategy by prefixing the Exec cmd with 'sh -c'

See https://askubuntu.com/a/1242773/32239

Author: Sylvain Pineau
Author Date: 2021-04-26 08:22:57 UTC

execution.py: share PERL5LIB in target execution environment

So far exclusively required by p-p-c inxi related jobs running as root

Author: Sylvain Pineau
Author Date: 2021-04-09 09:22:21 UTC

unit.py: Add a new template helper function: __is_running__(service)

checking if a systemd service is active and running

Author: Sylvain Pineau
Author Date: 2021-03-24 08:22:12 UTC

checkbox.json: Only send to C3 tha last line of the info/buildstamp job

Author: Sylvain Pineau
Author Date: 2020-10-25 16:17:47 UTC

urwid_ui: New ASCIIScreen class to render widgets w/o escape codes

Suitable for functional testing.
Enabled via the environment variable DISABLE_URWID_ESCAPE_CODES

Author: Sylvain Pineau
Author Date: 2020-10-21 08:12:28 UTC

remote_assistant: PEP8 fixes

Author: Sylvain Pineau
Author Date: 2020-10-08 11:57:55 UTC

ctrl.py: Turn "Ignoring job with missing template parameter" in to a debug msg

Author: Sylvain Pineau
Author Date: 2020-09-24 12:42:21 UTC

exporter:json: Only add the devices list if the udev_json attachment is non empty

Fixes: lp:1896881

Author: Sylvain Pineau
Author Date: 2020-09-02 08:50:27 UTC

resource.py: Fix the condition to favor the split_and_evaluate method

The following test never worked in practice:

if not '(' in self._text and ')' in self._text:

A corrected version would be:

if not ('(' in self._text and ')' in self._text):

But why bother checking a closing parenthesis...

Author: Sylvain Pineau
Author Date: 2020-08-21 12:59:27 UTC

validators: Allow a combination of template parameters and special functions

such as __checkbox_env__, __system_env__ and __on_ubuntucore__.

Author: Sylvain Pineau
Author Date: 2020-07-20 14:33:31 UTC

launcher:stages: Add support for the $C3_URL env var

Author: Sylvain Pineau
Author Date: 2020-07-16 11:23:22 UTC

provider_manager: Prefer universal_newlines=True, encoding is 3.6+

Author: Sylvain Pineau
Author Date: 2020-07-15 08:43:23 UTC

docs: New banner/title png

Author: Sylvain Pineau
Author Date: 2020-07-14 13:41:40 UTC

provider_manager: Create a subparser to only run a subset of tests

All options are mutually exclusive

Author: Sylvain Pineau
Author Date: 2020-06-25 10:12:54 UTC

session:test_assistant: Add test_external_pxu_size_limit

Author: Sylvain Pineau
Author Date: 2020-05-28 09:57:03 UTC

remote_assistant: Reset the normal_user from metadata when resuming sessions

Fixes: lp:1866597

Author: Sylvain Pineau
Author Date: 2020-04-19 16:01:00 UTC

remote_assistant: Remote API bump 10 -> 11

Author: Sylvain Pineau
Author Date: 2020-04-05 08:24:42 UTC

session:restart: Fix RemoteDebRestartStrategy with a default value for cache_dir

Fixes: lp:1870556

Author: Sylvain Pineau
Author Date: 2020-04-02 09:46:32 UTC

session:assistant: Add support for RemoteDebRestartStrategy

if noreturn flag is used, the restart_cmd_callback is set to reactivate the
slave service via the following calls:

$ sudo systemctl enable checkbox-ng.service
$ sudo systemctl start checkbox-ng.service

Author: Sylvain Pineau
Author Date: 2020-03-26 10:50:06 UTC

session:restart: Redirect stdout/err to /dev/console when using the SnappyRestartStrategy

Author: Sylvain Pineau
Author Date: 2020-03-23 09:11:00 UTC

remote_assistant: Add support for hide-resource-and-attachment & co

To limit unnecessary traffic between master and slave, one remaining feature
was the ui specific filter for resource and attachments.

In addition to the existing bufferedui, this patch introduce RemoteSilentUI
and borrow _get_ui_for_job from checkbox-ng subcommands.

Master then has three kinds of line to decode:

stderrblablabla
stdoutblablabla
hiddenblablabla

The first 6 chars are the stream identifier.
"hidden" is rendered with dark grey.

Author: Sylvain Pineau
Author Date: 2020-03-20 13:03:43 UTC

master: Only use the tqdm progress bars with a tty

Author: Sylvain Pineau
Author Date: 2020-03-20 09:38:28 UTC

session:remote_assistant: Remote API bump 9 -> 10

Author: Sylvain Pineau
Author Date: 2020-02-14 13:18:43 UTC

launcher: Fix manifest recording when test selection is forced

Author: Sylvain Pineau
Author Date: 2019-12-19 13:04:34 UTC

results.py: Ignore trailing garbage in job result record.gz files

The python gzip modules does not support trailing garbage as other gzip
command line tools does:

$ zcat com.cano
nical.certification__stress_stress-ng-test-for-class-scheduler.record.gz
[...]
gzip: com.canonical.certification__stress_stress-ng-test-for-class-scheduler.record.gz: decompression OK, trailing garbage ignored

If decompression works, checkbox should not crash and prevent the reports to be generated.

Author: Sylvain Pineau
Author Date: 2019-11-28 14:44:03 UTC

setup: avocado allergy

Author: Sylvain Pineau
Author Date: 2019-11-26 20:32:06 UTC

test_pod.py: Remove the checks on namedtuple internals

Python 3.8 breaks namedtuple properties.
See https://bugs.python.org/issue32492

Author: Sylvain Pineau
Author Date: 2019-11-11 17:33:37 UTC

master: Save the launcher manifest section on disk when test_selection_forced is set

Author: Sylvain Pineau
Author Date: 2019-11-11 17:33:37 UTC

master: Save the launcher manifest section on disk when test_selection_forced is set

Author: Sylvain Pineau
Author Date: 2019-11-07 16:25:20 UTC

remote_assistant: Remove unreachable break statement in prepare_extra_env

Author: Sylvain Pineau
Author Date: 2019-11-07 09:58:16 UTC

session:assistant: Ensure all jobs can write to CHECKBOX_DATA

Author: Sylvain Pineau
Author Date: 2019-11-05 10:31:41 UTC

remote:master: extend the socket timeout to 60s

Author: Sylvain Pineau
Author Date: 2019-11-05 09:50:00 UTC

remote_assistant: Prepare $DISPLAY using a subprocess if psutil < 4.0.0

On 16.04 psutil is 3.4.2-1 and doesn't provide Process.environ()

Author: Sylvain Pineau
Author Date: 2019-10-31 08:23:20 UTC

session:remote_assistant: Handle correctly psutil.AccessDenied

It should not happen since the remote slave is meant to run as root though.

Author: Sylvain Pineau
Author Date: 2019-10-29 15:57:58 UTC

remote:sa: pep8

Author: Sylvain Pineau
Author Date: 2019-10-30 10:32:01 UTC

remote:assistant: Prepare DISPLAY env var for get_differential_execution_environment

Only if a desktop user session is running, and only when a session starts or
resumes itself when reconnecting to the slave.

Fixes: lp:1849872

Author: Sylvain Pineau
Author Date: 2019-10-05 17:03:35 UTC

launcher:run: Don't print out byte streams we can't decode

Fixes: lp:1838366

Author: Sylvain Pineau
Author Date: 2019-10-07 07:14:45 UTC

exporter:tar: Add the junit report in the tarball

Fixes: lp:1811221

Author: Sylvain Pineau
Author Date: 2019-10-01 12:14:06 UTC

session:remote_assistant: Only sleep 0.01s to stream faster

Author: Sylvain Pineau
Author Date: 2019-09-25 11:23:36 UTC

execution: pep8

Author: Sylvain Pineau
Author Date: 2019-09-08 19:17:59 UTC

execution: Use proc.communicate() to supply password

The additional pipe creates a deadlock with commands like:

$ more foo | cat

Fixes: lp:1841702

Author: Pierre Equoy
Author Date: 2019-05-22 09:51:21 UTC

subcommands: Ensure submissions generated with `merge-*` commands are complete

Checkbox's `merge-reports` and `merge-submissions` subcommands rely on
an existing submission json file to spawn a new Checkbox session, then
export it in different formats (JSON, HTML, Excel).

The problem is that until now, the submission JSON files generated by
Checkbox lacked some important information, such as the full job ID or
the category ID.

Using such submission JSON file(s) with the `merge-reports` or
`merge-submissions` commands would result in incomplete new JSON
submissions.

This commit fixes this, so that a submission archive generated with the
`merge-submissions` command contains all the bits needed required by C3
for processing.

LP: #1817029

Author: Sylvain Pineau
Author Date: 2019-03-01 09:21:57 UTC

exporters:checkbox.html: Bundle image attachments in the html report (base64)

Author: Sylvain Pineau
Author Date: 2019-02-07 09:11:59 UTC

session:remote_assistant: Bump API version (4->5)

Author: Sylvain Pineau
Author Date: 2019-01-31 16:52:37 UTC

session:remote_assistant: Bump API version (4->5)

Author: Sylvain Pineau
Author Date: 2019-01-22 16:16:33 UTC

session:restart: Disable the snappy restart strategy when a service is already running

Author: Sylvain Pineau
Author Date: 2019-01-22 14:36:57 UTC

remote: Add support for failed jobs auto-retry

Author: Sylvain Pineau
Author Date: 2019-01-16 11:43:07 UTC

subcommands: Add a --nofake option to tp-export

Author: Sylvain Pineau
Author Date: 2018-12-10 13:52:59 UTC

subcommands:run: Add support for sideloaded providers

Author: Sylvain Pineau
Author Date: 2018-12-09 17:05:01 UTC

remote: Don't call wait_for_interaction_prompt for manual jobs

Manual jobs == jobs w/o a command

Author: Sylvain Pineau
Author Date: 2018-11-26 13:28:30 UTC

launchers:merge*: Make -o a required argument

Fixes lp:1804172

Author: Sylvain Pineau
Author Date: 2018-11-26 13:09:07 UTC

exporters:html: Update unit tests

Author: Sylvain Pineau
Author Date: 2018-11-06 13:01:26 UTC

exporters:data:multi-page.html: Remove the $(...).toolbar() call

Such call seems to load all sub pages in the DOM causing slowness
when loading the page the first time.

Author: Sylvain Pineau
Author Date: 2018-10-30 16:31:54 UTC

exporters:html: Disable autoescape for comments to preserve HTML tags

Including hyperlinks with <a></a> will work as intended

Author: Sylvain Pineau
Author Date: 2018-10-30 13:12:01 UTC

exporter:xlsx: Add category names to tp-export reports

Fixes: lp:1800614

Author: Sylvain Pineau
Author Date: 2018-10-29 12:00:30 UTC

checkbox-cli: Refactor merge-reports/submissions code

MergeSubmissions inherits MergeReports

Author: Sylvain Pineau
Author Date: 2018-10-25 13:00:24 UTC

checkbox-cli: New merge-reports command

Taking several submissions tarball to generate a single HTML report

Author: Sylvain Pineau
Author Date: 2018-10-25 09:23:25 UTC

checkbox-cli: New merge-reports command

Taking several submissions tarball to generate a single HTML report

Author: Sylvain Pineau
Author Date: 2018-10-11 12:42:53 UTC

provider_manager: Validate without context if special env var is set

PROVIDER_NO_VALIDATION_CONTEXT=1

Author: Sylvain Pineau
Author Date: 2018-10-11 12:42:53 UTC

provider_manager: Validate without context if special env var is set

PROVIDER_NO_VALIDATION_CONTEXT=1

Author: Sylvain Pineau
Author Date: 2018-09-27 15:17:55 UTC

ctrl: Don't process templates when there's no resources (i.e no I/O logs)

Author: Sylvain Pineau
Author Date: 2018-09-05 07:35:14 UTC

exporter:xlsx: Fix missing test results worksheet with standard xlsx export

Author: Sylvain Pineau
Author Date: 2018-08-31 07:09:58 UTC

session:assistant: set the runner_cls when resuming sessions too

Fixes lp:1790050

Author: Sylvain Pineau
Author Date: 2018-08-28 12:09:07 UTC

exporter:xlsx: New OPTION_TEST_PLAN_EXPORT to create just one worksheet

job partial_id / certification blocker / description|summary

Header set to the test plan name
Footer include page numbering
tab header (first line) repeated on each page

Author: Sylvain Pineau
Author Date: 2018-08-23 18:22:27 UTC

trusted-launcher: Generate after-suspend jobs from template jobs

Fixes lp:1778635

Author: Sylvain Pineau
Author Date: 2018-07-06 09:30:22 UTC

exporters:json: Add session title and job category names (instead of ids)

Author: Sylvain Pineau
Author Date: 2018-07-02 15:49:47 UTC

unit:testplan: Allow all automated jobs in bootstrap_include, not only resources

Useful when we have to run a shell command prior running a resource in order
to detect more devices for templates.

Author: Sylvain Pineau
Author Date: 2018-06-29 15:14:43 UTC

unit:testplan: Store bootstrap job ids in a list to preserve ordering

Author: Sylvain Pineau
Author Date: 2018-06-19 09:50:53 UTC

subcommands: Load and call the socket module getaddrinfo

This patch works around a bug in snapcraft and/or requests causing a segfault
when running from a classic snap on 18.04.

See https://forum.snapcraft.io/t/ld-library-path-in-classic-snap/5030/22

Author: Sylvain Pineau
Author Date: 2018-05-25 12:29:00 UTC

checkbox-ng:restart: Don't use the systemd service unit on classic

Author: Sylvain Pineau
Author Date: 2018-04-30 12:48:56 UTC

qml-shell: Fix qmlscene invocation

On 18.04, args have to be put in first and -- parameters must be avoided.

Author: Sylvain Pineau
Author Date: 2018-04-11 16:01:57 UTC

exporter:json: Only consider info/buildstamp and *_json jobs if they passed

Fixes lp:1762658

Author: Sylvain Pineau
Author Date: 2018-04-10 10:22:29 UTC

Check if os.getenv('USER') returns something before assuming a USER is defined

When checkbox is invoked a systemd service unit running as root, the USER env
variable is not defined leading to a crash in both ctrl and restart modules:

        user_mod = os.getenv('USER').replace('.', '%2E')
    AttributeError: 'NoneType' object has no attribute 'replace'

Author: Sylvain Pineau
Author Date: 2018-03-30 12:51:28 UTC

typo

Author: Sylvain Pineau
Author Date: 2018-03-01 12:11:29 UTC

launcher: Add the --message argument to provide a submission description

The content of the message can be a multiline variable. It will be stored
in the session metadata app_blob and recorded in the json report as a new
description field for C3.

For consistency, checkbox-cli submit gets the same feature. The trick to
support it though requires extraction of the submission archive to modify/add
the description data and a generation of a new archive in a temp dir.

Author: Sylvain Pineau
Author Date: 2018-02-21 20:37:25 UTC

subcommands: Fix the respawn_cmd when running from a snap

Author: Sylvain Pineau
Author Date: 2018-02-20 19:41:23 UTC

unit: Extend jinja2 parameters with checkbox config environment vars

Fixes: lp:1748371

Author: Sylvain Pineau
Author Date: 2018-02-19 12:12:22 UTC

exporter:tar: Minimize memory usage on low RAM systems

RAM Threshold set to 1 GiB. The LZMA compressor preset is then set to 0.

The use of SpooledTemporaryFile to generate xlsx, html and json files also
avoid generating them in memory if they exceed 100K.

Fixes: lp:1749099

Author: Sylvain Pineau
Author Date: 2018-02-13 19:22:45 UTC

QML jobs: Remove deprecated Ubuntu Components

- Bump QtQuick imported version to 2.5
- Remove units.gu, MainView, Arguments and PageStack.
- Add data/qml-shell to the MANIFEST.in

Author: Sylvain Pineau
Author Date: 2018-01-28 14:57:44 UTC

Fix builds on RTD

install_requires was missing

Author: Sylvain Pineau
Author Date: 2018-01-27 15:23:48 UTC

Only run documentation test on xenial or newer releases

Trusty does not support the alabaster theme requiring sphinx 1.3

Author: Sylvain Pineau
Author Date: 2017-12-24 15:16:27 UTC

Import get_providers from plainbox.impl.providers

Author: Sylvain Pineau
Author Date: 2017-11-09 12:26:51 UTC

Remove XML/HEXR exporter support

Author: Sylvain Pineau
Author Date: 2017-06-07 08:10:28 UTC

po:POTFILES.in: Refreshed

Author: Sylvain Pineau
Author Date: 2017-04-06 14:13:24 UTC

subcommands.py: Update submission service urls

Author: Sylvain Pineau
Author Date: 2017-04-05 09:04:09 UTC

certification: Create a dedicated SubmissionServiceTransport

Reuse of CertificationTransport is not possible as the new submission service
does not expect a form but a binary blob.

The difference is that using data is not encoding the body like a form,
but using files makes it a form.

Note: When the submission succeeded the path to the url is given in 'status_url'