Checkbox (Legacy)

Code review comment for lp:~bladernr/checkbox-legacy/fix-network-test-output-fail

fix-network-test-output-fail
Merge into trunk

Revision history for this message

Jeff Lane  (bladernr) wrote on 2014-09-09:

On Thu, Sep 4, 2014 at 1:06 PM, Zygmunt Krynicki
<email address hidden> wrote:
> Thanks for explaining that.
>
> I wonder about training costs given that (I hope) you are also using
> checkbox-ng in parallel with other releases. Am I missing something?

Well, the upside is that legacy checkbox is ONLY used for 12.04 certs,
of which there are very few, with Cisco and IBM being the only ones
showing interest in that now that 14.04 is out.

For 14.04 and everything beyond, we ONLY use checkbox-ng tooling.

The actual training costs are fairly low because at this point, the
testers have all been testing since pre-14.04, and the only real
training necessary was in using MAAS and in using checkbox-ng stuff.
The ONLY legacy training that I've had to do was for the IBM TSTL lab
in Taiwan because they were completely new to Ubuntu Training. There
MAY be others in the near future, but doubtful because I do not
believe we are pushing or encouraging 12.04 certs for anyone (we're
trying to avoid it, actually, except in cases where paying customers
are demanding it).

>
> On Thu, Sep 4, 2014 at 7:00 PM, Jeff Lane <email address hidden> wrote:
>> Because it's the tool in place for 12.04, so mostly because I'm
>> squeamish about switching the entire testing system mid-stream from
>> the established one. It's one thing to make a drastic tooling change
>> between releases, but my preference is to stay consistent across an
>> LTS.
>>
>> I could be convinced otherwise, but to be honest, 12.04 certs are so
>> few for us now that changing all the docs and re-training everyone to
>> use checkbox-ng wouldn't be worth it, IMO.
>>
>> On Thu, Sep 4, 2014 at 12:44 PM, Zygmunt Krynicki
>> <email address hidden> wrote:
>>> Jeff, quick question: why are you still using checkbox-legacy?
>>> --
>>> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
>>> You are the owner of lp:~bladernr/checkbox-legacy/fix-network-test-output-fail.
>>
>>
>>
>> --
>> "Entropy isn't what it used to be."
>>
>> Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior
>> Poet, Lover of Pie
>> Phone: 919-442-8649
>> Ubuntu Ham: W4KDH Freenode IRC: bladernr or bladernr_
>> gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417 C466 4ABD 3635 3A14 B2DD
>>
>> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
>> You are subscribed to branch lp:checkbox-legacy.
>
> --
> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
> You are the owner of lp:~bladernr/checkbox-legacy/fix-network-test-output-fail.

--
"Entropy isn't what it used to be."

Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior
Poet, Lover of Pie
Phone: 919-442-8649
Ubuntu Ham: W4KDH Freenode IRC: bladernr or bladernr_
gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417 C466 4ABD 3635 3A14 B2DD

On Thu, Sep 4, 2014 at 1:06 PM, Zygmunt Krynicki
<zygmunt.krynicki@canonical.com> wrote:
> Thanks for explaining that.
>
> I wonder about training costs given that (I hope) you are also using
> checkbox-ng in parallel with other releases. Am I missing something?

Well, the upside is that legacy checkbox is ONLY used for 12.04 certs,
of which there are very few, with Cisco and IBM being the only ones
showing interest in that now that 14.04 is out.

For 14.04 and everything beyond, we ONLY use checkbox-ng tooling.

The actual training costs are fairly low because at this point, the
testers have all been testing since pre-14.04, and the only real
training necessary was in using MAAS and in using checkbox-ng stuff.
The ONLY legacy training that I've had to do was for the IBM TSTL lab
in Taiwan because they were completely new to Ubuntu Training.  There
MAY be others in the near future, but doubtful because I do not
believe we are pushing or encouraging 12.04 certs for anyone (we're
trying to avoid it, actually, except in cases where paying customers
are demanding it).

>
> On Thu, Sep 4, 2014 at 7:00 PM, Jeff Lane <jeffrey.lane@canonical.com> wrote:
>> Because it's the tool in place for 12.04, so mostly because I'm
>> squeamish about switching the entire testing system mid-stream from
>> the established one.  It's one thing to make a drastic tooling change
>> between releases, but my preference is to stay consistent across an
>> LTS.
>>
>> I could be convinced otherwise, but to be honest, 12.04 certs are so
>> few for us now that changing all the docs and re-training everyone to
>> use checkbox-ng wouldn't be worth it, IMO.
>>
>> On Thu, Sep 4, 2014 at 12:44 PM, Zygmunt Krynicki
>> <zygmunt.krynicki@canonical.com> wrote:
>>> Jeff, quick question: why are you still using checkbox-legacy?
>>> --
>>> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
>>> You are the owner of lp:~bladernr/checkbox-legacy/fix-network-test-output-fail.
>>
>>
>>
>> --
>> "Entropy isn't what it used to be."
>>
>> Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior
>> Poet, Lover of Pie
>> Phone: 919-442-8649
>> Ubuntu Ham: W4KDH                          Freenode IRC: bladernr or bladernr_
>> gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417  C466 4ABD 3635 3A14 B2DD
>>
>> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
>> You are subscribed to branch lp:checkbox-legacy.
>
> --
> https://code.launchpad.net/~bladernr/checkbox-legacy/fix-network-test-output-fail/+merge/233379
> You are the owner of lp:~bladernr/checkbox-legacy/fix-network-test-output-fail.

-- 
"Entropy isn't what it used to be."

Jeff Lane - Server Certification Team Lead, Tools Developer, Warrior
Poet, Lover of Pie
Phone: 919-442-8649
Ubuntu Ham: W4KDH                          Freenode IRC: bladernr or bladernr_
gpg: 1024D/3A14B2DD 8C88 B076 0DD7 B404 1417  C466 4ABD 3635 3A14 B2DD

« Back to merge proposal