Merge lp:~fginther/adt-cloud-worker/uci-nova-mirror into lp:~canonical-ci-engineering/adt-cloud-worker/uci-nova

[Francis Ginther]

Add support for an optional archive mirror and add multiverse if it's specified.

Add support for an optional archive mirror and add multiverse if it's specified.

This should end up resolving:
 - https://trello.com/c/G4vSLPGN/2-1-proposed-migration-adt-testbeds-may-not-have-the-correct-version-of-packages-under-test
 - https://trello.com/c/z6YmEOQU/65-proposed-migration-enable-multiverse-in-apt-sources

[Evan (ev)]

I know where the multiverse requirement is coming from, but why do we need this optional archive mirror?

review: Needs Information

[Francis Ginther (fginther)]

Added some comments for reviewers.

[Francis Ginther (fginther)]

> I know where the multiverse requirement is coming from, but why do we need
> this optional archive mirror?

The existing adt VM tests use ftpmaster.internal as the archive source in order to have access to packages as soon as they are published. Without this, tests end up running against older versions of packages and proposed-migration can't detect this until it gets to britney (and then a manual retry is required). We can't force the use of ftpmaster.internal because it's not publicly available and we want to maintain the ability to use uci-nova in other environments.

Providing --mirror as an option was the only solution I've found so far for satisfying the above.

[Celso Providelo (cprov)]

Francis,

Thanks for implementing this feature. I agree it's required to be optional because it depends on the environment it's operating, i.e. the same repository used for triggering britney analysis.

Although it seems entirely unfortunate that instead of dealing with possible/transient inconsistencies (needs to test version X, but it's not available, will retry later) the adt-jenkins system relies on external arrangements to make sure it never happens (internal mirrors, apt-caches, extra load on ftpmaster, etc).

I think we can do a lot better, if we start requesting and monitoring tests in adt-cloud direct from britney (I don't mean direct amqp access as uci-britney, but instead the synchronous rest api we already have).

That said, let's see how the uci-nova workaround performs in production.

review: Approve

[Francis Ginther (fginther)]

Celso,

I fully agree. During the Austin sprint, cjwatson and jibel mentioned that there is an alternate means to ensure that a testbed has the correct version of the archive by comparing timestamps. But there is additional work in other parts of the proposed-migration process to make this functional. I believing 'fixing' that problem is outside the scope of what we need to accomplish for this story. But it should be part of a more thorough update when the time comes.

=== modified file 'uci-nova'
--- uci-nova	2015-04-22 03:06:12 +0000
+++ uci-nova	2015-04-22 03:06:12 +0000
@@ -17,6 +17,8 @@
 #        UUID of the network that should be used for the instance
 # -n name | --name=name
 #        Name for the new server. A name will be generated if not specified.
+# -m mirror | --mirror=mirror
+#        Optional ubuntu archive mirror to override the default.
 # -c console-log | --console=file-name
 #        Save the nova console-log of the server to the specified file.
 #
@@ -56,6 +58,7 @@
 SRVNAME=""
 NET_ID=""
 CONSOLE=""
+MIRROR=""
 DEBUG=""
 
 
@@ -75,8 +78,8 @@
 parse_args() {
     # Parse command line argument and populate environment
 
-    SHORTOPTS="f:,i:,N:,n:,c:,d"
-    LONGOPTS="flavor:,image:,net-id:,name:,console:,debug"
+    SHORTOPTS="f:,i:,N:,n:,m:,c:,d"
+    LONGOPTS="flavor:,image:,net-id:,name:,mirror:,console:,debug"
 
     TEMP=$(getopt -o $SHORTOPTS --long $LONGOPTS -- "$@")
     eval set -- "$TEMP"
@@ -95,6 +98,9 @@
             -n|--name)
                 SRVNAME=$2
                 shift 2;;
+            -m|--mirror)
+                MIRROR=$2
+                shift 2;;
             -c|--console)
                 CONSOLE=$2
                 shift 2;;
@@ -193,7 +199,21 @@
     else
         security_setup_nova
     fi
-        
+
+    # Generate a new apt sources.list using either the specified mirror
+    # or the test client's currently configured archive mirror. This includes
+    # adding multiverse which is not enabled in our cloud images by default.
+    #
+    # The following archive_setup uses an awk command to determine the release
+    # and archive mirror configured on the test client. $2 will be set to the
+    # archive mirror and $3 to the release. These are used before overwriting
+    # the test client's /etc/apt/sources.list file.
+    if [ -n "${MIRROR}" ]; then
+        archive_setup="mirror=${MIRROR}; release=\`awk '/^deb .*(debian|ubuntu)/ { print \$3; exit }' \"\$root/etc/apt/sources.list\"\`; echo \"deb \${mirror} \${release} main restricted universe multiverse\ndeb \${mirror} \${release}-updates main restricted universe multiverse\ndeb-src \${mirror} \${release} main restricted universe multiverse\ndeb-src \${mirror} \${release}-updates main restricted universe multiverse\" > /etc/apt/sources.list"
+    else
+        archive_setup="mirror_release=\`awk '/^deb .*(debian|ubuntu)/ { print \$2,\$3; exit }' \"\$root/etc/apt/sources.list\"\`; echo \"deb \${mirror_release} main restricted universe multiverse\ndeb \${mirror_release}-updates main restricted universe multiverse\ndeb-src \${mirror_release} main restricted universe multiverse\ndeb-src \${mirror_release}-updates main restricted universe multiverse\" > /etc/apt/sources.list"
+    fi
+
     # generate cloud-init user data; mostly for manage_etc_hosts, but also get
     # rid of some unnecessary stuff in the VM
     #
@@ -211,6 +231,8 @@
     ssh_enabled: True
 
 runcmd:
+ # Setup archive
+ - ${archive_setup}
  # Make apt faster:
  - echo 'Acquire::Languages "none";' > /etc/apt/apt.conf.d/90nolanguages
  - echo 'force-unsafe-io' > /etc/dpkg/dpkg.cfg.d/autopkgtest