curtin

Failed deployment with latest trunk

Bug #1609614 reported by Andres Rodriguez
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
curtin
Fix Released
Medium
Unassigned
curtin (Ubuntu)
Fix Released
Undecided
Unassigned
Xenial
Fix Released
Undecided
Unassigned

Bug Description

[Impact]

 * Curtin didn't handle dpkg-reconfigure of packages when MAAS supplied
   some debconf configuration. This prevented a Xenial daily image
   from being installed.

   Curtin has been updated to handle dpkg-reconfigure when
   debconf_selections was provided.

[Test Case]

 * Install proposed curtin package and deploy Xenial daily image

  PASS: Xenial Daily image successfully installs

  FAIL: Xenial Daily image fails to install with error message:

  chroot: failed to run command
    'dpkg-reconfigure--frontend=noninteractive':
    No such file or directory

[Regression Potential]

 * Low, this issue was uncovered using Curtin trunk, not in any
   released curtin package.

[Original Description]

--2016-08-04 02:39:19-- http://10.245.136.6:5248/images/ubuntu/amd64/generic/xenial/daily/root-tgz
Connecting to 10.245.136.6:5248... connected.
HTTP request sent, awaiting response... 200 OK
Length: 207661279 (198M) [text/html]
Saving to: 'STDOUT'

     0K ........ ........ ........ ........ ........ ........ 1% 7.81M 25s
  3072K ........ ........ ........ ........ ........ ........ 3% 11.1M 21s
  6144K ........ ........ ........ ........ ........ ........ 4% 11.2M 19s
  9216K ........ ........ ........ ........ ........ ........ 6% 11.2M 18s
 12288K ........ ........ ........ ........ ........ ........ 7% 11.1M 18s
 15360K ........ ........ ........ ........ ........ ........ 9% 11.2M 17s
 18432K ........ ........ ........ ........ ........ ........ 10% 11.2M 17s
 21504K ........ ........ ........ ........ ........ ........ 12% 11.2M 16s
 24576K ........ ........ ........ ........ ........ ........ 13% 11.2M 16s
 27648K ........ ........ ........ ........ ........ ........ 15% 11.2M 16s
 30720K ........ ........ ........ ........ ........ ........ 16% 11.2M 15s
 33792K ........ ........ ........ ........ ........ ........ 18% 11.2M 15s
 36864K ........ ........ ........ ........ ........ ........ 19% 11.1M 15s
 39936K ........ ........ ........ ........ ........ ........ 21% 10.9M 14s
 43008K ........ ........ ........ ........ ........ ........ 22% 11.2M 14s
 46080K ........ ........ ........ ........ ........ ........ 24% 11.1M 14s
 49152K ........ ........ ........ ........ ........ ........ 25% 10.8M 14s
 52224K ........ ........ ........ ........ ........ ........ 27% 10.5M 13s
 55296K ........ ........ ........ ........ ........ ........ 28% 10.3M 13s
 58368K ........ ........ ........ ........ ........ ........ 30% 10.3M 13s
 61440K ........ ........ ........ ........ ........ ........ 31% 11.1M 13s
 64512K ........ ........ ........ ........ ........ ........ 33% 11.2M 12s
 67584K ........ ........ ........ ........ ........ ........ 34% 10.7M 12s
 70656K ........ ........ ........ ........ ........ ........ 36% 11.0M 12s
 73728K ........ ........ ........ ........ ........ ........ 37% 11.2M 11s
 76800K ........ ........ ........ ........ ........ ........ 39% 11.2M 11s
 79872K ........ ........ ........ ........ ........ ........ 40% 10.5M 11s
 82944K ........ ........ ........ ........ ........ ........ 42% 10.7M 11s
 86016K ........ ........ ........ ........ ........ ........ 43% 10.7M 10s
 89088K ........ ........ ........ ........ ........ ........ 45% 11.0M 10s
 92160K ........ ........ ........ ........ ........ ........ 46% 11.2M 10s
 95232K ........ ........ ........ ........ ........ ........ 48% 11.2M 9s
 98304K ........ ........ ........ ........ ........ ........ 49% 11.2M 9s
101376K ........ ........ ........ ........ ........ ........ 51% 11.0M 9s
104448K ........ ........ ........ ........ ........ ........ 53% 10.8M 9s
107520K ........ ........ ........ ........ ........ ........ 54% 9.90M 8s
110592K ........ ........ ........ ........ ........ ........ 56% 9.71M 8s
113664K ........ ........ ........ ........ ........ ........ 57% 10.3M 8s
116736K ........ ........ ........ ........ ........ ........ 59% 11.2M 8s
119808K ........ ........ ........ ........ ........ ........ 60% 11.2M 7s
122880K ........ ........ ........ ........ ........ ........ 62% 11.2M 7s
125952K ........ ........ ........ ........ ........ ........ 63% 11.2M 7s
129024K ........ ........ ........ ........ ........ ........ 65% 11.2M 6s
132096K ........ ........ ........ ........ ........ ........ 66% 11.2M 6s
135168K ........ ........ ........ ........ ........ ........ 68% 11.2M 6s
138240K ........ ........ ........ ........ ........ ........ 69% 11.2M 6s
141312K ........ ........ ........ ........ ........ ........ 71% 11.2M 5s
144384K ........ ........ ........ ........ ........ ........ 72% 11.2M 5s
147456K ........ ........ ........ ........ ........ ........ 74% 11.1M 5s
150528K ........ ........ ........ ........ ........ ........ 75% 10.9M 4s
153600K ........ ........ ........ ........ ........ ........ 77% 10.9M 4s
156672K ........ ........ ........ ........ ........ ........ 78% 10.8M 4s
159744K ........ ........ ........ ........ ........ ........ 80% 10.8M 4s
162816K ........ ........ ........ ........ ........ ........ 81% 10.7M 3s
165888K ........ ........ ........ ........ ........ ........ 83% 10.7M 3s
168960K ........ ........ ........ ........ ........ ........ 84% 10.6M 3s
172032K ........ ........ ........ ........ ........ ........ 86% 10.3M 2s
175104K ........ ........ ........ ........ ........ ........ 87% 10.4M 2s
178176K ........ ........ ........ ........ ........ ........ 89% 10.4M 2s
181248K ........ ........ ........ ........ ........ ........ 90% 10.5M 2s
184320K ........ ........ ........ ........ ........ ........ 92% 10.2M 1s
187392K ........ ........ ........ ........ ........ ........ 93% 10.5M 1s
190464K ........ ........ ........ ........ ........ ........ 95% 10.4M 1s
193536K ........ ........ ........ ........ ........ ........ 96% 10.5M 1s
196608K ........ ........ ........ ........ ........ ........ 98% 10.5M 0s
199680K ........ ........ ........ ........ ........ ........ 99% 10.5M 0s
202752K 100% 11.5M=18s

2016-08-04 02:39:37 (10.8 MB/s) - written to stdout [207661279/207661279]

chroot: failed to run command 'dpkg-reconfigure--frontend=noninteractive': No such file or directory
Unexpected error while running command.
Command: ['chroot', '/tmp/tmpp8xaen18/target', 'dpkg-reconfigure--frontend=noninteractive', 'cloud-init']
Exit code: 127
Reason: -
Stdout: ''
Stderr: ''
Installation failed with exception: Unexpected error while running command.
Command: ['curtin', 'curthooks']
Exit code: 3
Reason: -
Stdout: b"chroot: failed to run command 'dpkg-reconfigure--frontend=noninteractive': No such file or directory\nUnexpected error while running command.\nCommand: ['chroot', '/tmp/tmpp8xaen18/target', 'dpkg-reconfigure--frontend=noninteractive', 'cloud-init']\nExit code: 127\nReason: -\nStdout: ''\nStderr: ''\n"
Stderr: ''

See original description

Related branches

lp:~smoser/curtin/trunk.fix-dpkg-reconfigure
Server Team CI bot: Needs Fixing (continuous-integration)
curtin developers: Pending requested
Diff: 274 lines (+156/-35)
5 files modified
curtin/commands/apt_config.py (+36/-28)
examples/tests/test_old_apt_features.yaml (+1/-0)
tests/unittests/test_apt_source.py (+103/-0)
tests/vmtests/__init__.py (+6/-6)
tests/vmtests/test_old_apt_features.py (+10/-1)
lp:~curtin-dev/curtin/trunk
lp:~raharper/ubuntu/xenial/curtin/pkg-sru-revno425
Scott Moser: Pending requested
Diff: 14513 lines (+10324/-1893)
94 files modified
Makefile (+3/-1)
curtin/__init__.py (+4/-0)
curtin/block/__init__.py (+249/-61)
curtin/block/clear_holders.py (+387/-0)
curtin/block/lvm.py (+96/-0)
curtin/block/mdadm.py (+18/-5)
curtin/block/mkfs.py (+10/-5)
curtin/commands/apply_net.py (+156/-1)
curtin/commands/apt_config.py (+668/-0)
curtin/commands/block_info.py (+75/-0)
curtin/commands/block_meta.py (+134/-263)
curtin/commands/block_wipe.py (+1/-2)
curtin/commands/clear_holders.py (+48/-0)
curtin/commands/curthooks.py (+61/-235)
curtin/commands/main.py (+4/-3)
curtin/config.py (+2/-3)
curtin/gpg.py (+74/-0)
curtin/net/__init__.py (+67/-30)
curtin/net/network_state.py (+45/-1)
curtin/util.py (+278/-81)
debian/changelog (+32/-2)
doc/conf.py (+21/-4)
doc/devel/README-vmtest.txt (+0/-152)
doc/devel/README.txt (+0/-55)
doc/devel/clear_holders_doc.txt (+85/-0)
doc/index.rst (+6/-0)
doc/topics/apt_source.rst (+164/-0)
doc/topics/config.rst (+551/-0)
doc/topics/development.rst (+68/-0)
doc/topics/integration-testing.rst (+245/-0)
doc/topics/networking.rst (+522/-0)
doc/topics/overview.rst (+7/-7)
doc/topics/reporting.rst (+3/-3)
doc/topics/storage.rst (+894/-0)
examples/apt-source.yaml (+267/-0)
examples/network-ipv6-bond-vlan.yaml (+56/-0)
examples/tests/apt_config_command.yaml (+85/-0)
examples/tests/apt_source_custom.yaml (+97/-0)
examples/tests/apt_source_modify.yaml (+92/-0)
examples/tests/apt_source_modify_arches.yaml (+102/-0)
examples/tests/apt_source_modify_disable_suite.yaml (+92/-0)
examples/tests/apt_source_preserve.yaml (+98/-0)
examples/tests/apt_source_search.yaml (+97/-0)
examples/tests/basic.yaml (+5/-1)
examples/tests/basic_network_static_ipv6.yaml (+22/-0)
examples/tests/basic_scsi.yaml (+1/-1)
examples/tests/network_alias.yaml (+125/-0)
examples/tests/network_mtu.yaml (+88/-0)
examples/tests/network_source_ipv6.yaml (+31/-0)
examples/tests/test_old_apt_features.yaml (+11/-0)
examples/tests/test_old_apt_features_ports.yaml (+10/-0)
examples/tests/uefi_basic.yaml (+15/-0)
examples/tests/vlan_network_ipv6.yaml (+92/-0)
setup.py (+2/-2)
tests/unittests/helpers.py (+41/-0)
tests/unittests/test_apt_custom_sources_list.py (+170/-0)
tests/unittests/test_apt_source.py (+1032/-0)
tests/unittests/test_block.py (+210/-0)
tests/unittests/test_block_lvm.py (+94/-0)
tests/unittests/test_block_mdadm.py (+28/-23)
tests/unittests/test_block_mkfs.py (+2/-2)
tests/unittests/test_clear_holders.py (+329/-0)
tests/unittests/test_make_dname.py (+200/-0)
tests/unittests/test_net.py (+54/-13)
tests/unittests/test_util.py (+180/-2)
tests/vmtests/__init__.py (+38/-38)
tests/vmtests/helpers.py (+129/-166)
tests/vmtests/test_apt_config_cmd.py (+55/-0)
tests/vmtests/test_apt_source.py (+238/-0)
tests/vmtests/test_basic.py (+21/-41)
tests/vmtests/test_bcache_basic.py (+5/-8)
tests/vmtests/test_bonding.py (+0/-204)
tests/vmtests/test_lvm.py (+2/-1)
tests/vmtests/test_mdadm_bcache.py (+21/-17)
tests/vmtests/test_multipath.py (+5/-13)
tests/vmtests/test_network.py (+205/-348)
tests/vmtests/test_network_alias.py (+40/-0)
tests/vmtests/test_network_bonding.py (+63/-0)
tests/vmtests/test_network_enisource.py (+91/-0)
tests/vmtests/test_network_ipv6.py (+53/-0)
tests/vmtests/test_network_ipv6_enisource.py (+26/-0)
tests/vmtests/test_network_ipv6_static.py (+42/-0)
tests/vmtests/test_network_ipv6_vlan.py (+34/-0)
tests/vmtests/test_network_mtu.py (+155/-0)
tests/vmtests/test_network_static.py (+44/-0)
tests/vmtests/test_network_vlan.py (+77/-0)
tests/vmtests/test_nvme.py (+2/-3)
tests/vmtests/test_old_apt_features.py (+89/-0)
tests/vmtests/test_raid5_bcache.py (+5/-8)
tests/vmtests/test_uefi_basic.py (+16/-18)
tools/jenkins-runner (+33/-7)
tools/launch (+9/-48)
tools/xkvm (+90/-2)
tox.ini (+30/-13)
Revision history for this message
Ryan Harper (raharper) wrote :

Can you attach your curtin config, I'd like to see why this isn't getting triggered in vmtests.

Changed in curtin:
importance: Undecided → Medium
status: New → Confirmed
Revision history for this message
Ryan Harper (raharper) wrote :

The error is in this string concat in apt_config.py

if len(to_config):
        util.subp(['dpkg-reconfigure' '--frontend=noninteractive'] +
                  list(to_config), data=None, target=target)

Missing the comma between command and parameters.

Revision history for this message
Ryan Harper (raharper) wrote :

Waiting on curtin config so we can fix test-cases.

Changed in curtin:
status: Confirmed → Incomplete
Revision history for this message
Andres Rodriguez (andreserl) wrote :

Hi Ryan,

Curtin config: http://paste.ubuntu.com/22222791/

Using maas trunk (lp:maas) with Xenial's curtin -> Deploys just fine.
Using maas trunk (lp:maas) with curtin trunk (lp:curtin) -> Deployment fails

Also, this is a CI run.

Thanks

Changed in curtin:
status: Incomplete → New
Revision history for this message
Scott Moser (smoser) wrote :

fixed in revno 412. marking fix-released as it was never broken in a release, so fix-committed in trunk is fix-released.

Changed in curtin:
status: New → Fix Committed
status: Fix Committed → Fix Released
Ryan Harper (raharper)
description: updated
Revision history for this message
Andy Whitcroft (apw) wrote : Please test proposed package

Hello Andres, or anyone else affected,

Accepted curtin into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/curtin/0.1.0~bzr425-0ubuntu1~16.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

tags: added: verification-needed
Andy Whitcroft (apw)
Changed in curtin (Ubuntu):
status: New → Fix Released
Changed in curtin (Ubuntu Xenial):
status: New → Fix Committed
Andres Rodriguez (andreserl)
tags: added: verification-done
removed: verification-needed
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package curtin - 0.1.0~bzr425-0ubuntu1~16.04.1

---------------
curtin (0.1.0~bzr425-0ubuntu1~16.04.1) xenial-proposed; urgency=medium

  [ Scott Moser ]
  * debian/new-upstream-snapshot: add writing of debian changelog entries.

  [ Ryan Harper ]
  * New upstream snapshot.
    - unittest,tox.ini: catch and fix issue with trusty-level mock of open
    - block/mdadm: add option to ignore mdadm_assemble errors (LP: #1618429)
    - curtin/doc: overhaul curtin documentation for readthedocs.org
      (LP: #1351085)
    - curtin.util: re-add support for RunInChroot (LP: #1617375)
    - curtin/net: overhaul of eni rendering to handle mixed ipv4/ipv6 configs
    - curtin.block: refactor clear_holders logic into block.clear_holders and
      cli cmd
    - curtin.apply_net should exit non-zero upon exception. (LP: #1615780)
    - apt: fix bug in disable_suites if sources.list line is blank.
    - vmtests: disable Wily in vmtests
    - Fix the unittests for test_apt_source.
    - get CURTIN_VMTEST_PARALLEL shown correctly in jenkins-runner output
    - fix vmtest check_file_strippedline to strip lines before comparing
    - fix whitespace damage in tests/vmtests/__init__.py
    - fix dpkg-reconfigure when debconf_selections was provided.
      (LP: #1609614)
    - fix apt tests on non-intel arch
    - Add apt features to curtin. (LP: #1574113)
    - vmtest: easier use of parallel and controlling timeouts
    - mkfs.vfat: add force flag for formating whole disks (LP: #1597923)
    - block.mkfs: fix sectorsize flag (LP: #1597522)
    - block_meta: cleanup use of sys_block_path and handle cciss knames
      (LP: #1562249)
    - block.get_blockdev_sector_size: handle _lsblock multi result return
      (LP: #1598310)
    - util: add target (chroot) support to subp, add target_path helper.
    - block_meta: fallback to parted if blkid does not produce output
      (LP: #1524031)
    - commands.block_wipe: correct default wipe mode to 'superblock'
    - tox.ini: run coverage normally rather than separately
    - move uefi boot knowledge from launch and vmtest to xkvm

 -- Ryan Harper <email address hidden> Mon, 03 Oct 2016 13:43:54 -0500

Changed in curtin (Ubuntu Xenial):
status: Fix Committed → Fix Released
Revision history for this message
Martin Pitt (pitti) wrote : Update Released

The verification of the Stable Release Update for curtin has completed successfully and the package has now been released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.