[SRU] cloud-init needs backport of SmartOS w/ ephemeral disk support

Worked out the precise port, which needs to be reviewed. It works as expected and provisions the ephemeral storage. Branch is attached.

Worked out raring port. It works as expected and provisions the ephemeral storage.

The following is the test case:

Azure upgrade test:
1. Booted current version on Azure with default user of utlemming
2. Ran 'apt-get -y purge walinuxagent* cloud-int'
3. Installed PPA packages
4. Restored machine to pre-provisioning state:
   rm -rf /var/lib/cloud
   rm /etc/cloud/cloud.cfg.d/90-azure.cfg
   userdel -f utlemming
   :> /etc/fstab
   service walinuxagent stop
   umount /mnt/resource
   wipefs --all /dev/sdb1
   [P/Q]: mkfs.ntfs -f /dev/sdb1
5. Configure for cloud-init:
   [PRECISE ONLY]: create ubuntu user: useradd -m ubuntu -s /bin/bash
   dpkg-reconfigure cloud-init (selected SmartOS, removed others)
6. Run cloud-init
   cloud-init init
   [PRECISE ONLY]: cloud-init-cfg modules
   [Q/R]: cloud-init modules --mode=config
7. Confirmed that:
   - user 'utlemming' was created
   - user 'utlemming' has sudo
   - user 'utlemming' has ssh keys populated
   - /dev/sdb1 is mount to /mnt
   - /dev/sdb1 is of type ext4, no label

Azure new image test (SSH key test):
1. Build from PPA
2. Boot cloud image with user 'utlemming' defined via cloud
3. Log-in as user
4. Make sure that:
 - user 'utlemming' was created
 - user 'utlemming' has sudo
 - user 'utlemming' has ssh keys populated
 - /dev/sdb1 is mount to /mnt
 - /dev/sdb1 is of type ext4, no label
5. Check /var/log/cloud-init.log for any exceptions

Azure new image test (Password Authentication)
1. Build from PPA
2. Boot cloud image with user 'utlemming' defined via cloud
3. Log-in as user
4. Make sure that:
 - user 'utlemming' was created
 - user 'utlemming' has sudo
 - no SSH keys should be populated
 - /dev/sdb1 is mount to /mnt
 - /dev/sdb1 is of type ext4, no label
5. Check /var/log/cloud-init.log for any exceptions

SmartOS:
1. Booted SmartOS 12.04
2. Upgraded to Raring
3. Restored to pre-boot provisioning:
   - removed /data from /etc/fstab
   - umounted /data
   - wipefs --all /dev/vdb1
   - delpart /dev/vdb 1
4. Install cloud-init from PPA
5. Configure for cloud-init boot:
   -run: dpkg-reconfigure cloud-init (selected SmartOS, removed others)
6. Run 'cloud-init init'
   - confirmed that ubuntu users exists
   - confirmed that the ubuntu user has SSH keys
   - confirmed that datasource is selected
7. Run 'cloud-init modules'
    - confirmed that /mnt is in /etc/fstab and correct
 - confirmed that /dev/vdb mounted /mnt
 - confirmed that default filesystem on /dev/vdb is ext3
 - confirmed that the label is 'ephemeral0' on /dev/vdb
8. Rebooted and confirmed that ubuntu user can login
8. Confirm logs are as expected

Upgrade test for Azure:
1. Add PPA
2. Update
3. Run 'apt-get -y dist-upgrade'
4. Get a diff of the package waagent:
diff -u /etc/waagent.conf /etc/waagent.conf.dpkg-dist
--- /etc/waagent.conf 2013-10-14 11:26:20.128885001 +0000
+++ /etc/waagent.conf.dpkg-dist 2013-10-15 15:01:48.816663901 +0000
@@ -15,7 +15,7 @@
 Provisioning.SshHostKeyPairType=rsa # Supported values are "rsa", "dsa" and "ecdsa".
 Provisioning.MonitorHostName=n # Monitor host name changes and publish changes via DHCP requests.

-ResourceDisk.Format=y # Format if unformatted. If 'n', resource disk will not be mounted.
+ResourceDisk.Format=n # Format if unformatted. If 'n', resource disk will not be mounted.
 ResourceDisk.Filesystem=ext4
 ResourceDisk.MountPoint=/mnt
 ResourceDisk.EnableSwap=n # Create and use swapfile on resource disk.
5. The diff should show that ResourceDisk.Format=y is in /etc/waagent.conf
6. Put a file in /mnt
7. Reboot
8. The file should remain after boot (confirms that the disk is not formated

EC2 Test:
1. Add PPA
2. Update
3. Run 'apt-get -y dist-upgrade'
4. Place file in /mnt
5. Reboot
6. Confirm file in /mnt
7. Machine should reboot normally.

Hello Ben, or anyone else affected,

Accepted cloud-init into precise-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/cloud-init/0.6.3-0ubuntu1.8 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Hello Ben, or anyone else affected,

Accepted cloud-init into raring-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/cloud-init/0.7.2-0ubuntu0.13.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance!

Verified both upgrade and new image paths. Marking as verification-done.

This bug was fixed in the package cloud-init - 0.6.3-0ubuntu1.8

---------------
cloud-init (0.6.3-0ubuntu1.8) precise-proposed; urgency=low

  * debian/patches/lp-1233315-add-smartos-support.patch:
    Add SmartOS DataSource, including disk format support (LP: #1233315).
  * debian/patches/lp-1231490-azure-ephemeral-format.patch:
    Format Windows Azure ephemeral disks (LP: #1231490)
  * debian/patches/lp-1233315-1231490-ephmeralX.Y-support.patch:
    Add support for referencing ephemeral devices as 'ephemeralX.Y
    (LP: #1231490, LP: #1233315)
 -- Ben Howard <email address hidden> Wed, 16 Oct 2013 08:17:35 -0600

This bug was fixed in the package cloud-init - 0.7.2-0ubuntu0.13.04.2

---------------
cloud-init (0.7.2-0ubuntu0.13.04.2) raring-proposed; urgency=low

  [ Ben Howard ]
  * debian/patches/lp-1233315-1231490-smartos_azure_disk_format.patch:
    Backport from upstream 0.7.4:
    * SmartOS datasource to support booting on SmartOS Cloud targets
        (LP: #1233315)
    * Support for ephemeral drive formating for SmartOS
    * Enable default ephemeral formating for Windows Azure (LP: #1231490)
    * Support for shorthand on default block mappings, i.e. ephemeral0.1
      for both mounts and disk formatting.
    * Use partition on mount directives if available (LP: #1231490).
  * debian/cloud-init.postinst: ensure that disk-setup module is not run
    on upgrade.
 -- Scott Moser <email address hidden> Mon, 21 Oct 2013 18:00:50 -0700