Weird transport error when submitting

Bug #1960584 reported by Jeff Lane 
40
This bug affects 5 people
Affects Status Importance Assigned to Milestone
Next Generation Checkbox (CLI)
Fix Released
Critical
Maciej Kisielewski
OEM Priority Project
Fix Released
Critical
Unassigned

Bug Description

I ran the my gpgpu test today and when checkbox tried submitting the file, I got this weird error I've never seen before:

file:///home/ubuntu/.local/share/checkbox-ng/submission_2022-02-11T04.27.54.875703.html
file:///home/ubuntu/.local/share/checkbox-ng/submission_2022-02-11T04.27.54.875703.junit.xml
WARNING:root:Transport skipped due to exporter error (/home/ubuntu/.local/share/checkbox-ng/submission_2022-02-11T04.27.54.875703.tar.xz)
WARNING:checkbox-ng.launcher.stages:Problem occured when preparing com.canonical.plainbox::tar report:['Expecting property name enclosed in double quotes: line 5739 column 19 (char 3512806)']
file:///home/ubuntu/.local/share/checkbox-ng/submission_2022-02-11T04.27.54.875703.junit.xml
Do you want to submit 'upload to certification' report?
  y => yes
  n => no
[yn]: y
Enter submission description (press Enter to skip): GPU snifftest
WARNING:root:Transport skipped due to exporter error (https://certification.canonical.com/api/v1/submission/vnDCsfJgz6biCkF2fS3Q25/)
WARNING:checkbox-ng.launcher.stages:Problem occured when preparing com.canonical.plainbox::tar report:['Expecting property name enclosed in double quotes: line 5740 column 19 (char 3512842)']
file:///home/ubuntu/.local/share/checkbox-ng/submission_2022-02-11T04.27.54.875703.junit.xml

This has worked fine in the past, and I've not changed anything on the gpgpu suite or launcher in a very long time. Not sure what's changed that's causing this error to happen now.

this is the launcher in use:
#!/usr/bin/env checkbox-cli

[launcher]
app_id = com.canonical.certification:certification-server
launcher_version = 1
stock_reports = submission_files, certification

[test plan]
unit = com.canonical.certification::gpgpu-only
forced = yes

[test selection]
forced = yes

[ui]
output = hide-resource-and-attachment

[config]
config_filename = canonical-certification.conf

Related branches

Jeff Lane  (bladernr)
tags: added: hwcert-server
Revision history for this message
Jeff Lane  (bladernr) wrote :

Saw this again when running the server suite locally on two new machines:
file:///root/.local/share/checkbox-ng/submission_2022-02-14T15.04.29.869154.html (H) Help
file:///root/.local/share/checkbox-ng/submission_2022-02-14T15.04.29.869154.junit.xml
WARNING:root:Transport skipped due to exporter error (/root/.local/share/checkbox-ng/submission_2022-02-14T15.04.29.869154.tar.xz)
WARNING:checkbox-ng.launcher.stages:Problem occured when preparing com.canonical.plainbox::tar report:['Expecting property name enclosed in double quotes: line 5416 column 19 (char 1735329)']
file:///root/.local/share/checkbox-ng/submission_2022-02-14T15.04.29.869154.junit.xml
Do you want to submit 'upload to certification' report?
  y => yes
  n => no
[yn]: y
Enter submission description (press Enter to skip): Initial Validation
WARNING:root:Transport skipped due to exporter error (https://certification.canonical.com/api/v1/submission/yWxS5NCiPTzwhym2Ycrf2X/)
WARNING:checkbox-ng.launcher.stages:Problem occured when preparing com.canonical.plainbox::tar report:['Expecting property name enclosed in double quotes: line 5417 column 19 (char 1735370)']
file:///root/.local/share/checkbox-ng/submission_2022-02-14T15.04.29.869154.junit.xml
ubuntu@octopot:~$

This was seen with the following config on two different machines:
Release: 20.04 LTS
ii checkbox-ng 1.16.0+git202201241420+pkg182~ubuntu20.04.1 all CheckBoxNG test runner
ii plainbox-provider-checkbox 0.63.0+git202202091055+pkg182~ubuntu20.04.1 amd64 CheckBox provider for PlainBox
ii python3-checkbox-ng 1.16.0+git202201241420+pkg182~ubuntu20.04.1 all CheckBoxNG test runner (Python 3 library)
ii python3-checkbox-support 0.53.0+git202202091035+pkg151~ubuntu20.04.1 all collection of Python modules used by PlainBox providers

When this occurs, the tarball is not created, and I've seen two different cases, the first case, .local/share/checkbox-ng only had the html and xml files but no other submission files, and on the second system, .local wasn't created at all (telling me checkbox never got as far as building the submission.

But both had the exact same error as noted in the summary.

Changed in checkbox-ng:
status: New → Confirmed
importance: Undecided → Critical
Changed in checkbox-ng:
status: Confirmed → In Progress
assignee: nobody → Maciej Kisielewski (kissiel)
Changed in oem-priority:
importance: Undecided → Critical
tags: added: oem-priority
Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

Could you attach the content of /var/tmp/checkbox-ng please? having the session files will help to reproduce the problem

Revision history for this message
Andy Chi (andch) wrote :

Hello @sylvain-pineau,
The attached file is session from /var/tmp/checkbox-ng, if I missed something, please let me know.

Revision history for this message
Maciej Kisielewski (kissiel) wrote :

Thanks, Andy for the file. Unfortunately it looks like the system doesn't have the session that produced that error (e.g. it got reprovisioned some time in the last month).

There's a chance that running the simple attachment info test plan can produce the problematic output. Could you try running this test plan com.canonical.certification::server-info-attachment-automated and if it produces the submission error could you attach that session dir? That would help tremendously.

Revision history for this message
Rod Smith (rodsmith) wrote :

Here's the contents of /var/tmp/checkbox-ng from a recent submission attempt on serviceberry, a server in the Server Certification lab. The submission failed as described here:

Do you want to submit 'upload to certification' report?
  y => yes
  n => no
[yn]: y
Enter submission description (press Enter to skip): Submission test
Enter secure-id:a002000000EuC0h
WARNING:root:Transport skipped due to exporter error (https://certification.canonical.com/api/v1/submission/a002000000EuC0h/)
WARNING:checkbox-ng.launcher.stages:Problem occured when preparing com.canonical.plainbox::tar report:['Expecting property name enclosed in double quotes: line 5365 column 19 (char 1989193)']
file:///home/ubuntu/.local/share/checkbox-ng/submission_2022-03-29T13.20.54.175860.junit.xml

Revision history for this message
Rod Smith (rodsmith) wrote :

Also in case it would be helpful, here's the contents of .local/share/checkbox-ng on the same server....

Revision history for this message
Sylvain Pineau (sylvain-pineau) wrote :

From a system hitting this bug, please tar the content of /var/tmp/checkbox-ng please.

Changed in checkbox-ng:
status: In Progress → Fix Committed
Revision history for this message
Jeff Lane  (bladernr) wrote :

I think I hit a new bug while trying to submit that is related to the fix for this bug

I filed a new bug here to cover the new error... https://bugs.launchpad.net/checkbox-ng/+bug/1968669

Changed in checkbox-ng:
status: Fix Committed → Fix Released
Changed in oem-priority:
status: New → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.