Merge ~binli/checkbox-support/+git/checkbox-support:utf8-decode-error into checkbox-support:master

[Bin Li]

[Bin Li (binli)]

I also tried use 'replace'
$ checkbox-cli run com.canonical.certification::udev_json | grep LNV
        "product": "LNV-5B10W51860\ufffd\ufffd",
        "product_slug": "LNV-5B10W51860__",
Finalizing session that hasn't been submitted anywhere: checkbox-run-2022-06-17T08.03.06

Using 'ignore'.
$ checkbox-cli run com.canonical.certification::udev_json | grep LNV
        "product": "LNV-5B10W51860",
        "product_slug": "LNV-5B10W51860",

[Sylvain Pineau (sylvain-pineau)]

Thanks a lot, this patch will definitely improve the robustness of out parser.

review: Approve

diff --git a/checkbox_support/parsers/__init__.py b/checkbox_support/parsers/__init__.py
index dd928d8..a031a17 100644
--- a/checkbox_support/parsers/__init__.py
+++ b/checkbox_support/parsers/__init__.py
@@ -71,7 +71,7 @@ def main():
         raise SystemExit()
     parser = AVAILABLE_PARSERS[args.parser_name]
     stdin = sys.stdin
-    with io.TextIOWrapper(sys.stdin.buffer, encoding='utf-8') as stdin:
+    with io.TextIOWrapper(sys.stdin.buffer, encoding='utf-8', errors='ignore') as stdin:
         try:
             text = stdin.read()
             print(run_parsing(parser, text))