Merge lp:~lamont/maas/xenial-has-released into lp:~maas-committers/maas/trunk

[LaMont Jones]

Xenial has released. Drop the old code from before it did.

Xenial has released. Drop the old code from before it did.

[Lee Trager (ltrager)]

Thanks for cleaning that up!

review: Approve

[Andres Rodriguez (andreserl)]

We are hardcoding this for a reason. This is to prevent that the next LTS release cause the same issues as it caused when Xenial was out.

review: Disapprove

[LaMont Jones (lamont)]

> We are hardcoding this for a reason. This is to prevent that the next LTS
> release cause the same issues as it caused when Xenial was out.

The code being removed literally says "if trusty is the current LTS, that's a lie, it's xenial" -- that situation will not reoccur for at least 26 years, and requires that we be silly enough to reuse both "trusty" and "xenial"....

If we want to keep the code, it should probably turn into something that says "use the current devel release if it's LTS" -- that would need a prod vs dev switch, but is very doable. (the new release gets added to distro-info shortly after it opens, and we'd just need to see that devel opened and that it's an LTS.)

[LaMont Jones (lamont)]

> > We are hardcoding this for a reason. This is to prevent that the next LTS
> > release cause the same issues as it caused when Xenial was out.
>
> The code being removed literally says "if trusty is the current LTS, that's a
> lie, it's xenial" -- that situation will not reoccur for at least 26 years,
> and requires that we be silly enough to reuse both "trusty" and "xenial"....
>
> If we want to keep the code, it should probably turn into something that says
> "use the current devel release if it's LTS" -- that would need a prod vs dev
> switch, but is very doable. (the new release gets added to distro-info shortly
> after it opens, and we'd just need to see that devel opened and that it's an
> LTS.)

Also, it's trivial for devs to override the LTS release name in the database. (Which I did for a while when I was using yakkety to test ipv6, because we had the packages there, but not in xenial yet.)

[lp:~lamont/maas/xenial-has-released]

5838. By LaMont Jones on 2017-03-23

Choose our LTS for commissioning based on a date which has an LTS we know we
support, since each LTS of Ubuntu has a potential for breaking MAAS (python
version changes, etc). (xenial release broke MAAS 1.x, and we expect that the
next LTS is likely to break MAAS 2.x.)

5839. By LaMont Jones on 2017-03-23

Do not support commissioning on a release if that release is no longer supported by Ubuntu.

[Lee Trager (ltrager)]

MAAS looks up what the latest LTS is using the DistroInfo library. This library contains a list of all released Ubuntu and Debian releases. For 2.0 we wanted to test Xenial as the default before it was released so I hard coded it in. This does not lock us to Xenial, it simply says if DistroInfo thinks the latest release is Trusty, use Xenial.

It looks like we're going to hardcode Xenial so even when 18.04 comes out Xenial will be used, I'm fine with that just two questions below.

review: Needs Information

[LaMont Jones (lamont)]

Ultimately, it's Andres' call, but I think it's a conscious decision on our part in the 18.04 cycle to say "yes, when it comes out, maas will support it", rather than blithely running our installed base into the crusher.

I think I do still need to rework it for that case, so that we can set maas_lts_date into the future, and have it not take effect until that date (that is, we look at the earlier date of "now" and "maas_lts_date".)

Andres?

[Mike Pontillo (mpontillo)]

I think the safest thing to do (and this is oversimplifying) is:

    return 'xenial';

Why? Because we have no way of knowing whether or not our commissioning scripts will work on any other LTS. They're only well-tested on Xenial. When the next LTS arrives, along with it will come a version of MAAS that has been tested with LTS-next. At which time we would re-test our commissioning scripts with LTS-next and change the hard-coded release.

When LTS-next arrives, current MAAS 2.2 users might break if we suddenly change commissioning to use LTS-next.

We should have a way to override this so that we can CI-test commissioning with development releases.

Unmerged revisions

5839. By LaMont Jones on 2017-03-23

Do not support commissioning on a release if that release is no longer supported by Ubuntu.

5838. By LaMont Jones on 2017-03-23

Choose our LTS for commissioning based on a date which has an LTS we know we
support, since each LTS of Ubuntu has a potential for breaking MAAS (python
version changes, etc). (xenial release broke MAAS 1.x, and we expect that the
next LTS is likely to break MAAS 2.x.)

5837. By LaMont Jones on 2017-03-22

Remove some dead code.

=== modified file 'src/provisioningserver/drivers/osystem/tests/test_ubuntu.py'
--- src/provisioningserver/drivers/osystem/tests/test_ubuntu.py	2016-07-06 05:37:58 +0000
+++ src/provisioningserver/drivers/osystem/tests/test_ubuntu.py	2017-03-23 17:21:39 +0000
@@ -13,18 +13,17 @@
 from maastesting.factory import factory
 from maastesting.testcase import MAASTestCase
 from provisioningserver.drivers.osystem import BOOT_IMAGE_PURPOSE
-from provisioningserver.drivers.osystem.ubuntu import UbuntuOS
+from provisioningserver.drivers.osystem.ubuntu import (
+    maas_lts_date,
+    UbuntuOS,
+)
 
 
 class TestUbuntuOS(MAASTestCase):
 
     def get_lts_release(self):
-        # XXX ltrager 2016-04-06 - python3-distro-info won't set the latest lts
-        # to Xenial until its been released. So we can start testing MAAS 2.0
-        # with Xenial by default override it here. Once Xenial is released this
-        # can be removed
-        # return UbuntuDistroInfo().lts()
-        return "xenial"
+        # The LTS release is hardcoded for a version of maas by date.
+        return UbuntuDistroInfo().lts(maas_lts_date)
 
     def get_release_title(self, release):
         info = UbuntuDistroInfo()
@@ -53,8 +52,8 @@
 
     def test_get_default_release(self):
         osystem = UbuntuOS()
-        expected = osystem.get_default_release()
-        self.assertEqual(expected, self.get_lts_release())
+        actual = osystem.get_default_release()
+        self.assertEqual(actual, self.get_lts_release())
 
     def test_get_supported_commissioning_releases(self):
         self.patch_autospec(UbuntuDistroInfo, "is_lts").return_value = True
@@ -111,8 +110,8 @@
 
     def test_default_commissioning_release(self):
         osystem = UbuntuOS()
-        expected = osystem.get_default_commissioning_release()
-        self.assertEqual(expected, self.get_lts_release())
+        actual = osystem.get_default_commissioning_release()
+        self.assertEqual(actual, self.get_lts_release())
 
     def test_get_release_title(self):
         osystem = UbuntuOS()

=== modified file 'src/provisioningserver/drivers/osystem/ubuntu.py'
--- src/provisioningserver/drivers/osystem/ubuntu.py	2016-07-06 05:37:58 +0000
+++ src/provisioningserver/drivers/osystem/ubuntu.py	2017-03-23 17:21:39 +0000
@@ -4,11 +4,13 @@
 """Ubuntu Operating System."""
 
 __all__ = [
+    "maas_lts_date",
     "UbuntuOS",
     ]
 
 import os
 
+from datetime import date
 from distro_info import UbuntuDistroInfo
 from provisioningserver.config import ClusterConfiguration
 from provisioningserver.drivers.osystem import (
@@ -16,6 +18,9 @@
     OperatingSystem,
 )
 
+# The last LTS maas 2.x supports for commissioning is xenial.
+maas_lts_date = date(2016, 4, 30)
+
 
 class UbuntuOS(OperatingSystem):
     """Ubuntu operating system."""
@@ -42,15 +47,8 @@
 
     def get_lts_release(self):
         """Return the latest Ubuntu LTS release."""
-        lts_release = self.ubuntu_distro_info.lts()
-        # XXX ltrager 2016-04-06 - python3-distro-info won't set the latest lts
-        # to Xenial until its been released. So we can start testing MAAS 2.0
-        # with Xenial by default override it here. Once Xenial is released this
-        # can be removed
-        if lts_release == "trusty":
-            return "xenial"
-        else:
-            return lts_release
+        lts_release = self.ubuntu_distro_info.lts(maas_lts_date)
+        return lts_release
 
     def get_default_release(self):
         """Gets the default release to use when a release is not
@@ -63,9 +61,14 @@
         system that supports commissioning.
         """
         unsupported_releases = ['precise']
-        return [name for name in self.ubuntu_distro_info.supported()
-                if name not in unsupported_releases
-                if self.ubuntu_distro_info.is_lts(name)]
+        # Return the list of still-supported lts releases that were supported
+        # on maas_lts_date.
+        return [
+            name
+            for name in self.ubuntu_distro_info.supported(maas_lts_date)
+            if name not in unsupported_releases
+            if self.ubuntu_distro_info.is_lts(name)
+            if name in self.ubuntu_distro_info.supported()]
 
     def get_default_commissioning_release(self):
         """Gets the default commissioning release for Ubuntu. This only exists