Merge lp:~nskaggs/juju-release-tools/add-daily-build into lp:juju-release-tools

[Nicholas Skaggs]

Add date and build for blessed build support

[Curtis Hovey (sinzui)]

I don't think the change is complete and I think this breaks our official releases.

build_package.py is used to make testing an real packages. I think these changes will create packages we intend to release our devel and stable PPAs with dates and hashes in them. The script that extracts agents from packages is sensitive to the binary package names. I doubt agents can be created for official streams because the binary package names will have date and hashes in them.

I think "make test" will fail. juju-release-scripts is a production project that manages releases and the agent archive. We need tests to ensure releases are boring.

I have some suggestions inline.

review: Needs Information (core)

[lp:~nskaggs/juju-release-tools/add-daily-build]

301. By Nicholas Skaggs on 2016-05-02

add revid too

302. By Nicholas Skaggs on 2016-05-02

make everything new optional

303. By Nicholas Skaggs on 2016-05-02

fix ordering and tests

304. By Nicholas Skaggs on 2016-05-02

add daily tests

[Nicholas Skaggs (nskaggs)]

I made a new template string. Feel free to comment on things like we really need -ubuntu in there, etc.

I also added tests -- anything else you'd like to see specific to daily?

In addition, I did a test run using this new code with the existing job to ensure I didn't break anything: http://juju-ci.vapour.ws/view/Release, package, publish/job/release-juju-create-source-packages-test/1/

[Curtis Hovey (sinzui)]

Your change looks good, but I believe something is incomplete. Looking at
    http://juju-ci.vapour.ws:8080/job/release-juju-create-source-packages-daily/
I see a orig.tar.gz that is identical to what we have uploaded before:
    juju-core_2.0-beta6.orig.tar.gz

The orig.tar.gz name is identical to the official package we released at
     http://juju-ci.vapour.ws:8080/job/release-juju-create-source-packages/

Lp never forgets a tarfile. A new orig file was not uploaded. Instead, Lp accepted the tarfile because its hash is identical to the one previously uploaded. Anything tarfile that claims to have the same name, btu a different hash will be rejected because it could be a man in the middle attack. When release-juju-create-source-packages-daily creates juju-core_2.0-beta6.orig.tar.gz, the next version (juju-core_2.0-beta7.orig.tar.gz) we will never be able to release 2.0-beta7.

I think a single rule in build_source() will suffice to avoid this problem. Before we create the SourceFile, we get the version from the tarfile. We can rename the tarfile. Maybe we can change these lines

    tarfile_name = os.path.basename(tarfile_path)
    version = tarfile_name.split('_')[-1].replace('.tar.gz', '')

to something like:

    tarfile_name = os.path.basename(tarfile_path)
    version = tarfile_name.split('_')[-1].replace('.tar.gz', '')
    if revid:
        daily_version = {}~{}'.format(version, revid)
        daily_tarfile_name = tarfile_name.replace(version, daily_version)
        tarfile_dir = os.path.dirname(tarfile_path)
        daily_tarfile_path = os.path.join(tarfile_dir, daily_tarfile_name)
        os.rename(tarfile_path, daily_tarfile_path)
        tarfile_path = daily_tarfile_path

^ I typed that really fast. It probably has errors. Maybe we want the orig to have the date and build id too. Maybe this should be extracted to a helper function that is easy to test.

    tarfile_name = os.path.basename(tarfile_path)
    version = tarfile_name.split('_')[-1].replace('.tar.gz', '')
    if revid:
        tarfile_path = rename_daily_tarfile(tarfile_path, version, revid)

review: Needs Fixing (code)

[lp:~nskaggs/juju-release-tools/add-daily-build]

305. By Nicholas Skaggs on 2016-05-03

add unique name for daily tarball

306. By Nicholas Skaggs on 2016-05-03

just set names; revamp tests

307. By Nicholas Skaggs on 2016-05-03

rename

308. By Nicholas Skaggs on 2016-05-03

flake8

[Nicholas Skaggs (nskaggs)]

Ok, refactored tests to use scenarios. I stopped myself from going too crazy. I believe you have unique tarballs now too:

http://juju-ci.vapour.ws/job/release-juju-create-source-packages-daily/15/

[Curtis Hovey (sinzui)]

Thank you Nicholas.

The test refactorings were unexpected and challenging to read as they look to like a total rewrite when they are not. In general, a branch should not exceed 400 lines. I would have made the testscenarios change in a separate branch. I can see this is a nice addition. I have but one quibble over a test name in line.

The hosts that use this project will fail their these tests because python-testscenarios is not installed by any of our other deps. This project's deps are unified with juju-ci-tools. It's Makefile will provide the deps for for juju-release-tools. That isn't true any more :(. I accept python-testscenarios. I think we need a new Makefile target that installs: python-testscenarios. The good news is we do not need to make this project work on windows, centos, or os x.

HOWEVER. Something is wrong and I don't see anything wrong in your implementation. Look at
    http://juju-ci.vapour.ws/job/release-juju-create-source-packages-daily/15/artifact/juju-build-trusty-all/juju-core_2.0-beta6-20160503+3921+4bbce805~14.04.dsc
^ I see juju-core_2.0-beta6.orig.tar.gz in there. We don't want that uploaded. I don't see how it exists since I see os.rename. I think the tar file is renamed immediately. We pass the new tarfile name to the step that imports it. I see this confirmed at
    http://juju-ci.vapour.ws/job/release-juju-create-source-packages-daily/ws/juju-build-any-all/
When I look at
     http://juju-ci.vapour.ws/job/release-juju-create-source-packages-daily/ws/juju-build-trusty-all/
I see our new version as the debian tar, but not the orig.

Oh. I think I know. create_source_package_branch() takes version. It "sets" the version of the upstream tarfile being imported...oh wow.

1 we need to pass the new version so that the call to create the pristine-tar returns the right version for the orig.
2. um maybe we didn't need to rename the tarfile because I think the spb's pristine-tar always becomes the .orig.

review: Needs Information (code)

[Curtis Hovey (sinzui)]

Hi Nicholas.

After reading this code again. I don't think we need to rename the tarfile. In stead we want to pass a revised version to create_source_package_branch().

1. The call to import-upstream uses version because the upstream tar file is not guaranteed to be debian friendly. The "version" we pass is used to bzr to recreate the orig tarfile as needed.

2. The step to import the tarfile is done in its own sub dir (*.all-all) to keep it isolated from the dirs that make source packages.

3. I think is collides with the changes to create_source_package() which wants to make the source package version. :( Since the version, revid date etc was applied outside of create_source_package() it will make a mistake. Either we continue to pass the original version to this function, or we choose to make this function accept the version passed.

Sorry for advising you

[lp:~nskaggs/juju-release-tools/add-daily-build]

309. By Nicholas Skaggs on 2016-05-04

fix version for orig tarball

[Nicholas Skaggs (nskaggs)]

So Curtis, looking this morning the answer was rather simple, heh. I looked at the function and agreed with you. I fixed the test as well and everything has the long version string now. Here's an output for you to grok.

http://juju-ci.vapour.ws/job/release-juju-create-source-packages-daily/21/

[Curtis Hovey (sinzui)]

Thank you very much.

review: Approve (code)

=== modified file 'build_package.py'
--- build_package.py	2016-04-14 22:08:19 +0000
+++ build_package.py	2016-05-04 14:09:15 +0000
@@ -115,6 +115,7 @@
 
 
 UBUNTU_VERSION_TEMPLATE = '{version}-0ubuntu1~{release}.{upatch}~juju1'
+DAILY_VERSION_TEMPLATE = '{version}-{date}+{build}+{revid}~{release}'
 
 
 VERSION_PATTERN = re.compile('(\d+)\.(\d+)\.(\d+)')
@@ -317,18 +318,28 @@
     return spb
 
 
-def make_ubuntu_version(series, version, upatch=1):
+def make_ubuntu_version(series, version, upatch=1,
+                        date=None, build=None, revid=None):
     """Return an Ubuntu package version.
 
     :param series: The series codename.
     :param version: The upstream version.
     :param upatch: The package patch number for cases where a packaging rules
         are updated and the package rebuilt.
+    :param date: The date of the build.
+    :param build: The build number in CI.
+    :param revid: The revid hash of the source.
     :return: An Ubuntu version string.
     """
     release = juju_series.get_version(series)
-    return UBUNTU_VERSION_TEMPLATE.format(
-        version=version, release=release, upatch=upatch)
+    # if daily params are set, we make daily build
+    if all([date, build, revid]):
+        return DAILY_VERSION_TEMPLATE.format(
+            version=version, release=release, upatch=upatch,
+            date=date, build=build, revid=revid)
+    else:
+        return UBUNTU_VERSION_TEMPLATE.format(
+            version=version, release=release, upatch=upatch)
 
 
 def make_changelog_message(version, bugs=None):
@@ -382,8 +393,9 @@
 
 
 def create_source_package(source_dir, spb, series, version,
-                          upatch='1', bugs=None, gpgcmd=None,
-                          debemail=None, debfullname=None, verbose=False):
+                          upatch='1', bugs=None, gpgcmd=None, debemail=None,
+                          debfullname=None, verbose=False,
+                          date=None, build=None, revid=None):
     """Create a series source package from a source package branch.
 
     The new source package can be used to create series source packages.
@@ -401,8 +413,13 @@
     :param debemail: The email address to attribute the changelog entry to.
     :param debfullname: The name to attribute the changelog entry to.
     :param verbose: Increase the information about the work performed.
+    :param date: The date of the build.
+    :param build: The build number in CI.
+    :param revid: The revid hash of the source.
     """
-    ubuntu_version = make_ubuntu_version(series, version, upatch)
+
+    ubuntu_version = make_ubuntu_version(series, version, upatch,
+                                         date, build, revid)
     message = make_changelog_message(version, bugs=bugs)
     source = os.path.join(source_dir, 'source')
     env = make_deb_shell_env(debemail, debfullname)
@@ -416,7 +433,8 @@
 
 def build_source(tarfile_path, location, series, bugs,
                  debemail=None, debfullname=None, gpgcmd=None,
-                 branch=None, upatch=1, verbose=False):
+                 branch=None, upatch=1, verbose=False,
+                 date=None, build=None, revid=None):
     """Build one or more series source packages from a new release tarfile.
 
     The packages are unsigned by default, but providing the path to a gpgcmd,
@@ -435,12 +453,25 @@
     :param upatch: The package patch number for cases where a packaging rules
         are updated and the package rebuilt.
     :param verbose: Increase the verbostiy of output.
+    :param date: The date of the build.
+    :param build: The build number in CI.
+    :param revid: The revid hash of the source.
     :return: the exit code (which is 0 or else an exception was raised).
     """
     if not isinstance(series, list):
         series = [series]
     tarfile_name = os.path.basename(tarfile_path)
     version = tarfile_name.split('_')[-1].replace('.tar.gz', '')
+    if all([date, build, revid]):
+        daily_version = '{}~{}~{}~{}'.format(version, date, build, revid)
+        daily_tarfile_name = tarfile_name.replace(version, daily_version)
+        tarfile_dir = os.path.dirname(tarfile_path)
+        daily_tarfile_path = os.path.join(tarfile_dir, daily_tarfile_name)
+        os.rename(tarfile_name, daily_tarfile_name)
+        tarfile_path = daily_tarfile_path
+        tarfile_name = daily_tarfile_name
+        version = daily_version
+
     files = [SourceFile(None, None, tarfile_name, tarfile_path)]
     spb_dir = setup_local(
         location, 'any', 'all', files, verbose=verbose)
@@ -448,9 +479,10 @@
     for a_series in series:
         build_dir = setup_local(location, a_series, 'all', [], verbose=verbose)
         create_source_package(
-            build_dir, spb, a_series, version, upatch=upatch, bugs=bugs,
-            gpgcmd=gpgcmd, debemail=debemail, debfullname=debfullname,
-            verbose=verbose)
+            build_dir, spb, a_series, version,
+            upatch=upatch, bugs=bugs, gpgcmd=gpgcmd,
+            debemail=debemail, debfullname=debfullname, verbose=verbose,
+            date=date, build=build, revid=revid)
     return 0
 
 
@@ -473,7 +505,8 @@
             args.tar_file, args.location, args.series, args.bugs,
             debemail=args.debemail, debfullname=args.debfullname,
             gpgcmd=args.gpgcmd, branch=args.branch, upatch=args.upatch,
-            verbose=args.verbose)
+            verbose=args.verbose,
+            date=args.date, build=args.build, revid=args.revid)
     elif args.command == 'binary':
         exitcode = build_binary(
             args.dsc, args.location, args.series, args.arch,
@@ -510,6 +543,12 @@
     src_parser.add_argument(
         'series', help="The destination Ubuntu release or LIVING for all.")
     src_parser.add_argument(
+        '--date', default=None, help="A datestamp to apply to the build")
+    src_parser.add_argument(
+        '--build', default=None, help="The build number from CI")
+    src_parser.add_argument(
+        '--revid', default=None, help="The short hash for revid")
+    src_parser.add_argument(
         'bugs', nargs='*', help="Bugs this version will fix in the release.")
     bin_parser = subparsers.add_parser('binary', help='Build a binary package')
     bin_parser.add_argument(

=== modified file 'tests/test_build_package.py'
--- tests/test_build_package.py	2016-02-10 18:39:43 +0000
+++ tests/test_build_package.py	2016-05-04 14:09:15 +0000
@@ -8,6 +8,7 @@
 from StringIO import StringIO
 from textwrap import dedent
 import unittest
+from testscenarios import TestWithScenarios
 
 from build_package import (
     _JujuSeries,
@@ -165,70 +166,6 @@
         bb_mock.assert_called_with(
             'my.dsc', '~/workspace', 'trusty', 'i386', ppa=None, verbose=False)
 
-    def test_get_args_source(self):
-        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
-        with patch.dict('os.environ', shell_env):
-            args = get_args(
-                ['prog', 'source', 'my_1.25.0.tar.gz', '~/workspace', 'trusty',
-                 '123', '456'])
-        self.assertEqual('source', args.command)
-        self.assertEqual('my_1.25.0.tar.gz', args.tar_file)
-        self.assertEqual('~/workspace', args.location)
-        self.assertEqual('trusty', args.series)
-        self.assertEqual(['123', '456'], args.bugs)
-        self.assertEqual('me@email', args.debemail)
-        self.assertEqual('me', args.debfullname)
-        self.assertIsNone(args.gpgcmd)
-        self.assertEqual(DEFAULT_SPB, args.branch)
-        self.assertEqual('1', args.upatch)
-        self.assertFalse(args.verbose)
-
-    def test_get_args_source_default_spb2_branch(self):
-        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
-        with patch.dict('os.environ', shell_env):
-            args = get_args(
-                ['prog', 'source', 'my_2.0-a.tar.gz', '~/workspace', 'trusty',
-                 '123', '456'])
-        self.assertEqual('source', args.command)
-        self.assertEqual('my_2.0-a.tar.gz', args.tar_file)
-        self.assertEqual(DEFAULT_SPB2, args.branch)
-
-    def test_get_args_source_with_branch(self):
-        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
-        with patch.dict('os.environ', shell_env):
-            args = get_args(
-                ['prog', 'source', 'my_2.0-a.tar.gz', '~/workspace', 'trusty',
-                 '123', '456', '--branch', '~/my-branch'])
-        self.assertEqual('source', args.command)
-        self.assertEqual('my_2.0-a.tar.gz', args.tar_file)
-        self.assertEqual('~/my-branch', args.branch)
-
-    def test_get_args_source_with_living(self):
-        with patch('build_package.juju_series.get_living_names', autospec=True,
-                   return_value=['precise', 'trusty']) as js_mock:
-            args = get_args(
-                ['prog', 'source', 'my.tar.gz', '~/workspace', 'LIVING',
-                 '123', '456'])
-        self.assertEqual(['precise', 'trusty'], args.series)
-        self.assertEqual(1, js_mock.call_count)
-        args = get_args(
-            ['prog', 'source', 'my.tar.gz', '~/workspace', 'LIVING',
-             '123', '456'])
-        self.assertEqual(juju_series.get_living_names(), args.series)
-
-    def test_main_source(self):
-        with patch('build_package.build_source', autospec=True,
-                   return_value=0) as bs_mock:
-            code = main([
-                'prog', 'source',
-                '--debemail', 'me@email', '--debfullname', 'me',
-                'my.tar.gz', '~/workspace', 'trusty', '123', '456'])
-        self.assertEqual(0, code)
-        bs_mock.assert_called_with(
-            'my.tar.gz', '~/workspace', 'trusty', ['123', '456'],
-            debemail='me@email', debfullname='me', gpgcmd=None,
-            branch=DEFAULT_SPB, upatch='1', verbose=False)
-
     @autopatch('build_package.move_debs', return_value=True)
     @autopatch('build_package.teardown_lxc', return_value=True)
     @autopatch('build_package.build_in_lxc')
@@ -380,28 +317,6 @@
             found = move_debs(build_dir, workspace)
             self.assertFalse(found)
 
-    @autopatch('build_package.create_source_package')
-    @autopatch('build_package.create_source_package_branch',
-               return_value='./spb_path')
-    @autopatch('build_package.setup_local',
-               side_effect=['./spb_dir', './precise_dir', './trusty_dir'])
-    def test_build_source(self, sl_mock, spb_mock, csp_mock):
-        return_code = build_source(
-            './my_1.2.3.tar.gz', './workspace', ['precise', 'trusty'], ['987'],
-            debemail=None, debfullname=None, gpgcmd='my/gpg',
-            branch='lp:branch', upatch=None, verbose=False)
-        sl_mock.assert_any_call(
-            './workspace', 'any', 'all',
-            [SourceFile(None, None, 'my_1.2.3.tar.gz', './my_1.2.3.tar.gz')],
-            verbose=False)
-        spb_mock.assert_called_with(
-            './spb_dir', '1.2.3', 'my_1.2.3.tar.gz', 'lp:branch')
-        sl_mock.assert_any_call(
-            './workspace', 'precise', 'all', [], verbose=False)
-        sl_mock.assert_any_call(
-            './workspace', 'trusty', 'all', [], verbose=False)
-        self.assertEqual(0, return_code)
-
     @autopatch('subprocess.check_call')
     def test_create_source_package_branch(self, cc_mock):
         spb = create_source_package_branch(
@@ -433,41 +348,6 @@
             'New upstream stable point release. (LP #987, LP #876)',
             message)
 
-    @autopatch('build_package.sign_source_package')
-    @autopatch('subprocess.check_call')
-    def test_create_source_package(self, cc_mock, ss_mock):
-        create_source_package(
-            '/juju-build-trusty-all', '/juju-build-any-all/spb', 'trusty',
-            '1.2.3', upatch='1', bugs=['987'], gpgcmd=None,
-            debemail='me@email', debfullname='me', verbose=False)
-        script = BUILD_SOURCE_TEMPLATE.format(
-            spb='/juju-build-any-all/spb',
-            source='/juju-build-trusty-all/source',
-            series='trusty', ubuntu_version='1.2.3-0ubuntu1~14.04.1~juju1',
-            message='New upstream stable point release. (LP #987)')
-        env = make_deb_shell_env('me@email', 'me')
-        cc_mock.assert_called_with(
-            [script], shell=True, cwd='/juju-build-trusty-all', env=env)
-        self.assertEqual(0, ss_mock.call_count)
-
-    @autopatch('build_package.sign_source_package')
-    @autopatch('subprocess.check_call')
-    def test_create_source_package_with_gpgcmd(self, cc_mock, ss_mock):
-        create_source_package(
-            '/juju-build-trusty-all', '/juju-build-any-all/spb', 'trusty',
-            '1.2.3', upatch='1', bugs=['987'], gpgcmd='/my/gpgcmd',
-            debemail='me@email', debfullname='me', verbose=False)
-        script = BUILD_SOURCE_TEMPLATE.format(
-            spb='/juju-build-any-all/spb',
-            source='/juju-build-trusty-all/source',
-            series='trusty', ubuntu_version='1.2.3-0ubuntu1~14.04.1~juju1',
-            message='New upstream stable point release. (LP #987)')
-        env = make_deb_shell_env('me@email', 'me')
-        cc_mock.assert_called_with(
-            [script], shell=True, cwd='/juju-build-trusty-all', env=env)
-        ss_mock.assert_called_with(
-            '/juju-build-trusty-all', '/my/gpgcmd', 'me@email', 'me')
-
     @autopatch('subprocess.check_call')
     def test_sign_source_package(self, cc_mock):
         sign_source_package(
@@ -508,3 +388,263 @@
             package_version='1.25.0-0ubuntu1~16.04.1~juju1')
         self.assertEqual(0, code)
         self.assertEqual('xenial\n', so_mock.getvalue())
+
+
+class CreateBuildSource(TestWithScenarios):
+
+    scenarios = [
+        ('release',
+            {'date': None,
+             'build': None,
+             'revid': None,
+             'version': '1.2.3',
+             'original_tarfile_name': None,
+             'tarfile_name': 'my_1.2.3.tar.gz',
+             'tarfile_path': './my_1.2.3.tar.gz'
+             }),
+
+        ('daily',
+            {'date': '20160502',
+             'build': '3065',
+             'revid': '4bbce805',
+             'version': '1.2.3~20160502~3065~4bbce805',
+             'original_tarfile_name': 'my_1.2.3.tar.gz',
+             'tarfile_name': 'my_1.2.3~20160502~3065~4bbce805.tar.gz',
+             'tarfile_path': './my_1.2.3~20160502~3065~4bbce805.tar.gz'
+             }),
+        ('broken_daily',
+            {'date': None,
+             'build': '3065',
+             'revid': '4bbce805',
+             'version': '1.2.3',
+             'original_tarfile_name': None,
+             'tarfile_name': 'my_1.2.3.tar.gz',
+             'tarfile_path': './my_1.2.3.tar.gz'
+             })
+    ]
+
+    @autopatch('build_package.create_source_package')
+    @autopatch('build_package.create_source_package_branch',
+               return_value='./spb_path')
+    @autopatch('build_package.setup_local',
+               side_effect=['./spb_dir', './precise_dir', './trusty_dir'])
+    @autopatch('build_package.os.rename', return_value=True)
+    def test_build_source_test(self, os_mock, sl_mock, spb_mock, csp_mock):
+        return_code = build_source(
+            './my_1.2.3.tar.gz', './workspace', ['precise', 'trusty'], ['987'],
+            debemail=None, debfullname=None, gpgcmd='my/gpg',
+            branch='lp:branch', upatch=None, verbose=False,
+            date=self.date, build=self.build, revid=self.revid)
+        if self.original_tarfile_name is not None:
+            os_mock.assert_called_with(self.original_tarfile_name,
+                                       self.tarfile_name)
+        sl_mock.assert_any_call(
+            './workspace', 'any', 'all',
+            [SourceFile(None, None, self.tarfile_name, self.tarfile_path)],
+            verbose=False)
+        spb_mock.assert_called_with(
+            './spb_dir', self.version, self.tarfile_name, 'lp:branch')
+        sl_mock.assert_any_call(
+            './workspace', 'precise', 'all', [], verbose=False)
+        sl_mock.assert_any_call(
+            './workspace', 'trusty', 'all', [], verbose=False)
+        self.assertEqual(0, return_code)
+
+
+class CreateSourcePackageTests(TestWithScenarios):
+
+    scenarios = [
+        ('release',
+            {'date': None,
+             'build': None,
+             'revid': None,
+             'ubuntu_version': '1.2.3-0ubuntu1~14.04.1~juju1'
+             }),
+
+        ('daily',
+            {'date': '20160502',
+             'build': '3065',
+             'revid': '4bbce805',
+             'ubuntu_version': '1.2.3-20160502+3065+4bbce805~14.04'
+             }),
+        ('broken_daily',
+            {'date': None,
+             'build': '3065',
+             'revid': '4bbce805',
+             'ubuntu_version': '1.2.3-0ubuntu1~14.04.1~juju1'
+             })
+    ]
+
+    @autopatch('build_package.sign_source_package')
+    @autopatch('subprocess.check_call')
+    def test_create_source_package(self, cc_mock, ss_mock):
+        create_source_package(
+            '/juju-build-trusty-all', '/juju-build-any-all/spb', 'trusty',
+            '1.2.3', upatch='1', bugs=['987'], gpgcmd=None,
+            debemail='me@email', debfullname='me', verbose=False,
+            date=self.date, build=self.build, revid=self.revid)
+        script = BUILD_SOURCE_TEMPLATE.format(
+            spb='/juju-build-any-all/spb',
+            source='/juju-build-trusty-all/source',
+            series='trusty',
+            ubuntu_version=self.ubuntu_version,
+            message='New upstream stable point release. (LP #987)')
+        env = make_deb_shell_env('me@email', 'me')
+        cc_mock.assert_called_with(
+            [script], shell=True, cwd='/juju-build-trusty-all', env=env)
+        self.assertEqual(0, ss_mock.call_count)
+
+    @autopatch('build_package.sign_source_package')
+    @autopatch('subprocess.check_call')
+    def test_create_source_package_with_gpgcmd(self, cc_mock, ss_mock):
+        create_source_package(
+            '/juju-build-trusty-all', '/juju-build-any-all/spb', 'trusty',
+            '1.2.3', upatch='1', bugs=['987'], gpgcmd='/my/gpgcmd',
+            debemail='me@email', debfullname='me', verbose=False,
+            date=self.date, build=self.build, revid=self.revid)
+        script = BUILD_SOURCE_TEMPLATE.format(
+            spb='/juju-build-any-all/spb',
+            source='/juju-build-trusty-all/source',
+            series='trusty',
+            ubuntu_version=self.ubuntu_version,
+            message='New upstream stable point release. (LP #987)')
+        env = make_deb_shell_env('me@email', 'me')
+        cc_mock.assert_called_with(
+            [script], shell=True, cwd='/juju-build-trusty-all', env=env)
+        ss_mock.assert_called_with(
+            '/juju-build-trusty-all', '/my/gpgcmd', 'me@email', 'me')
+
+
+class GetArgsTests(TestWithScenarios):
+
+    scenarios = [
+        ('release',
+            {'date': None,
+             'build': None,
+             'revid': None
+             }),
+
+        ('daily',
+            {'date': '20160502',
+             'build': '3065',
+             'revid': '4bbce805'
+             }),
+        ('broken_daily',
+            {'date': None,
+             'build': '3065',
+             'revid': '4bbce805'
+             })
+    ]
+
+    def test_get_args_source(self):
+        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
+        with patch.dict('os.environ', shell_env):
+            args_list = ['prog', 'source', 'my_1.25.0.tar.gz', '~/workspace',
+                         'trusty', '123', '456']
+            if self.date:
+                args_list.append('--date')
+                args_list.append(self.date)
+            if self.build:
+                args_list.append('--build')
+                args_list.append(self.build)
+            if self.revid:
+                args_list.append('--revid')
+                args_list.append(self.revid)
+            args = get_args(args_list)
+        self.assertEqual('source', args.command)
+        self.assertEqual('my_1.25.0.tar.gz', args.tar_file)
+        self.assertEqual('~/workspace', args.location)
+        self.assertEqual('trusty', args.series)
+        self.assertEqual(['123', '456'], args.bugs)
+        self.assertEqual('me@email', args.debemail)
+        self.assertEqual('me', args.debfullname)
+        self.assertIsNone(args.gpgcmd)
+        self.assertEqual(DEFAULT_SPB, args.branch)
+        self.assertEqual('1', args.upatch)
+        self.assertFalse(args.verbose)
+        self.assertEqual(self.date, args.date)
+        self.assertEqual(self.build, args.build)
+        self.assertEqual(self.revid, args.revid)
+
+    def test_get_args_source_default_spb2_branch(self):
+        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
+        with patch.dict('os.environ', shell_env):
+            args_list = ['prog', 'source', 'my_2.0-a.tar.gz', '~/workspace',
+                         'trusty', '123', '456']
+            if self.date:
+                args_list.append('--date')
+                args_list.append(self.date)
+            if self.build:
+                args_list.append('--build')
+                args_list.append(self.build)
+            if self.revid:
+                args_list.append('--revid')
+                args_list.append(self.revid)
+            args = get_args(args_list)
+        self.assertEqual('source', args.command)
+        self.assertEqual('my_2.0-a.tar.gz', args.tar_file)
+        self.assertEqual(DEFAULT_SPB2, args.branch)
+
+    def test_get_args_source_with_branch(self):
+        shell_env = {'DEBEMAIL': 'me@email', 'DEBFULLNAME': 'me'}
+        with patch.dict('os.environ', shell_env):
+            args_list = ['prog', 'source', 'my_2.0-a.tar.gz', '~/workspace',
+                         'trusty', '123', '456', '--branch', '~/my-branch']
+            if self.date:
+                args_list.append('--date')
+                args_list.append(self.date)
+            if self.build:
+                args_list.append('--build')
+                args_list.append(self.build)
+            if self.revid:
+                args_list.append('--revid')
+                args_list.append(self.revid)
+            args = get_args(args_list)
+        self.assertEqual('source', args.command)
+        self.assertEqual('my_2.0-a.tar.gz', args.tar_file)
+        self.assertEqual('~/my-branch', args.branch)
+
+    def test_get_args_source_with_living(self):
+        with patch('build_package.juju_series.get_living_names', autospec=True,
+                   return_value=['precise', 'trusty']) as js_mock:
+            args_list = ['prog', 'source', 'my.tar.gz', '~/workspace',
+                         'LIVING', '123', '456']
+            if self.date:
+                args_list.append('--date')
+                args_list.append(self.date)
+            if self.build:
+                args_list.append('--build')
+                args_list.append(self.build)
+            if self.revid:
+                args_list.append('--revid')
+                args_list.append(self.revid)
+            args = get_args(args_list)
+        self.assertEqual(['precise', 'trusty'], args.series)
+        self.assertEqual(1, js_mock.call_count)
+        args = get_args(
+            ['prog', 'source', 'my.tar.gz', '~/workspace', 'LIVING',
+             '123', '456'])
+        self.assertEqual(juju_series.get_living_names(), args.series)
+
+    def test_main_source(self):
+        with patch('build_package.build_source', autospec=True,
+                   return_value=0) as bs_mock:
+            args_list = ['prog', 'source', '--debemail', 'me@email',
+                         '--debfullname', 'me', 'my.tar.gz', '~/workspace',
+                         'trusty', '123', '456']
+            if self.date:
+                args_list.append('--date')
+                args_list.append(self.date)
+            if self.build:
+                args_list.append('--build')
+                args_list.append(self.build)
+            if self.revid:
+                args_list.append('--revid')
+                args_list.append(self.revid)
+            code = main(args_list)
+        self.assertEqual(0, code)
+        bs_mock.assert_called_with(
+            'my.tar.gz', '~/workspace', 'trusty', ['123', '456'],
+            debemail='me@email', debfullname='me', gpgcmd=None,
+            branch=DEFAULT_SPB, upatch='1', verbose=False,
+            date=self.date, build=self.build, revid=self.revid)