MRE updates 19.11.10 and 20.11.3

Bug #1940913 reported by Christian Ehrhardt 
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
dpdk (Ubuntu)
Fix Released
High
Unassigned
Focal
Fix Released
Medium
Unassigned
Hirsute
Fix Released
Medium
Unassigned

Bug Description

Hi,
This bug tracks an update for the DPDK packages in:
- Focal 19.11.7 -> 19.11.10
- Hirsute 20.11.1 -> 20.11.3
- Impish 20.11.2 -> 20.11.3

This update includes bugfixes only following the SRU policy exception defined at https://wiki.ubuntu.com/StableReleaseUpdates/DPDK.

No new features added, a classic stable release with a bunch of fixes aggregated and enhanced testing by the companies being part of the DPDK community.

[Impact]

Stable release update so not directly applicable; see the exception policy document linked above.
For Reference - former cases are here:
- https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1784816
- https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1817675
- https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1836365
- https://bugs.launchpad.net/ubuntu/+source/dpdk/+bug/1912464

[Major Changes]

As listed by upstream

For Focal:
19.11.8 https://doc.dpdk.org/guides-19.11/rel_notes/release_19_11.html#id22
19.11.9 https://doc.dpdk.org/guides-19.11/rel_notes/release_19_11.html#id25
19.11.10 https://doc.dpdk.org/guides-19.11/rel_notes/release_19_11.html#id29

For Hirsute
20.11.2 https://doc.dpdk.org/guides-20.11/rel_notes/release_20_11.html#id1

For Hirsute&Impish
20.11.3 https://doc.dpdk.org/guides-20.11/rel_notes/release_20_11.html#id5

[Test Plan]

See https://wiki.ubuntu.com/StableReleaseUpdates/DPDK#SRU_TestVerify

[Regression Potential]

Upstream performs extensive testing before release, giving us a high degree of confidence in the general case. There problems are most likely to manifest in Ubuntu-specific integrations, such as in relation to the versions of dependencies available and other packaging-specific matters.

--- initial report ---

There were a few ups and downs but the stable releases 19.11.10 and 20.11.3 should be good to be considered as MRE SRU now.

Currently in RC phase they would help to further stabilize DPDK based Ubuntu solutions.

http://mails.dpdk.org/archives/dev/2021-August/216985.html
http://mails.dpdk.org/archives/dev/2021-August/216427.html

Related branches

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Since this is a bug-fix only package which would be SRUed Impish will be synced from Debian unstable where we will make it available once released.
(All our Ubuntu Delta that is in impish's 20.11.2-1ubuntu2 is in salsa already - so 20.11.3-1 will be syncable then)

Changed in dpdk (Ubuntu):
status: New → Triaged
description: updated
Changed in dpdk (Ubuntu Focal):
status: New → Triaged
Changed in dpdk (Ubuntu Hirsute):
status: New → Triaged
Changed in dpdk (Ubuntu):
importance: Undecided → High
Changed in dpdk (Ubuntu Focal):
importance: Undecided → Medium
Changed in dpdk (Ubuntu Hirsute):
importance: Undecided → Medium
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Tests completed and reported upstream.
We have to wait for more tests to come in.

Also one issue was identified so at least 19.11.10 will still slightly change.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

19.11.10 is released, Luca is working on 20.11.3 now and later today I can prep these uploads.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :
description: updated
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Hmm, in extended verification I just happened to find that the Hirsute build of 20.11.3 might need some test improvements. They are in the impish packaging already and were not needed in the former 20.11.1 but now might be.

@SRU Team please do not accept this to Hirsute before I give it a green light. If it slips in by accident I can always provide a respin with a fix, but if I can find it right away that would make things somewhat simpler.

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Ok, it came down to this:
 37/59 DPDK:fast-tests / table_autotest TIMEOUT 30.37s

And while it worked about two weeks ago in Hirsute it now does not.
On a rebuild locally (sbuild) and in launchpad and they both worked.

But everyone hates flaky tests, and we have enough others to ensure coverage.
I'm cherry picking the test fix that we have added for this in impish to hirsute.

For hirsute I have uploaded 20.11.3-0ubuntu0.21.04.2 which includes those test fixes that we already have had in impish. That makes it more reliable overall. I have added a bug task and SRU template to the related bug 1939861.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package dpdk - 20.11.3-0ubuntu1

---------------
dpdk (20.11.3-0ubuntu1) impish; urgency=medium

  * Merge LTS stable release 20.11.3 (LP: #1940913)
    Release notes are available at:
    https://doc.dpdk.org/guides-20.11/rel_notes/release_20_11.html#id1
    - Remove test-catch-coredumps.patch [now part of upstream]
  * d/p/u/lp-1940957-net-i40e-support-25G-AOC-ACC-cables.patch: fix issues
    with 25G AOC cables (LP: #1940957)

 -- Christian Ehrhardt <email address hidden> Tue, 24 Aug 2021 12:28:59 +0200

Changed in dpdk (Ubuntu):
status: Triaged → Fix Released
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Test builds with test-fixes are good.
Ok, thereby all is ready and good - uploaded to F/H-unapproved waiting for the SRU team to accept.

Revision history for this message
Łukasz Zemczak (sil2100) wrote :

Thank you for preparing this SRU, Christian! I see there's quite a lot of changes in those minor releases (I'm always worried about the changes that 'remove' stuff!) - but seeing the amount of testing done upstream and by your team, I think it's safe to proceed.

Changed in dpdk (Ubuntu Hirsute):
status: Triaged → Fix Committed
tags: added: verification-needed verification-needed-hirsute
Revision history for this message
Łukasz Zemczak (sil2100) wrote : Please test proposed package

Hello Christian, or anyone else affected,

Accepted dpdk into hirsute-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/20.11.3-0ubuntu0.21.04.2 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-hirsute to verification-done-hirsute. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-hirsute. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Revision history for this message
Łukasz Zemczak (sil2100) wrote :

Hello Christian, or anyone else affected,

Accepted dpdk into focal-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/dpdk/19.11.10-0ubuntu0.20.04.1 in a few hours, and then in the -proposed repository.

Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, what testing has been performed on the package and change the tag from verification-needed-focal to verification-done-focal. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-focal. In either case, without details of your testing we will not be able to proceed.

Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping!

N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days.

Changed in dpdk (Ubuntu Focal):
status: Triaged → Fix Committed
tags: added: verification-needed-focal
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

FYI there was a build fail, but due to a networking blip in the build env "Unable to connect to ftpmaster.internal. I've restarted that build (amd64 on focal)

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Build was (as expected) happy on a retry.
Starting tests ...

Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Regression tested 21.04

PHYS_TESTPMD
VIRT_SPAWNGUESTS
VIRT_TESTPMD
VIRT_L2FWD
BENCH_OVS
VUC_BENCH_OVSDPDK
VUC_ENDURANCE_STARTSTOP
VUC_ENDURANCE_ADDREMOVEPORT

1.0.0 (07:06:44): phys (BM) tests
  1.1.0 (07:06:44): initialize environment
    1.1.1 (08:41:06): testpmd => Pass
    1.1.2 (08:42:14): check testpmd output => Pass
2.0.0 (08:42:14): prep virtual test environment

1.0.0 (08:44:13): virt tests
  1.1.0 (08:44:13): initialize environment
3.0.0 (08:45:11): performance tests
  3.1.0 (08:45:11): prep benchmarks
  3.2.0 (08:45:33): performance tests
    3.2.1 (08:45:49): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (09:04:31): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (09:09:16): VUC endurance checks
  4.1.0 (09:09:16): prep VUC endurance tests
    4.1.1 (09:18:31): start stop guests (client) => Pass
    4.1.2 (10:32:43): add/remove ports (client) => Pass
  4.2.0 (10:41:38): Final cleanup

I'll need to re-deoploy to test Focal next

tags: added: verification-done-hirsute
removed: verification-needed-hirsute
Revision history for this message
Christian Ehrhardt  (paelzer) wrote :

Focal completed as well

PHYS_TESTPMD
VIRT_SPAWNGUESTS
VIRT_TESTPMD
VIRT_L2FWD
BENCH_OVS
VUC_BENCH_OVSDPDK
VUC_ENDURANCE_STARTSTOP
VUC_ENDURANCE_ADDREMOVEPORT

1.0.0 (12:23:20): phys (BM) tests
  1.1.0 (12:23:20): initialize environment
    1.1.1 (12:24:49): testpmd => Pass
    1.1.2 (12:25:34): check testpmd output => Pass
2.0.0 (12:25:34): prep virtual test environment

1.0.0 (12:27:41): virt tests
  1.1.0 (12:27:41): initialize environment
3.0.0 (12:28:17): performance tests
  3.1.0 (12:28:17): prep benchmarks
  3.2.0 (12:28:40): performance tests
    3.2.1 (12:28:49): test guest-openvswitch for OVS-5CPU => Pass
    3.2.2 (12:47:49): test guest-dpdk-vhost-user-client-multiq for OVSDPDK-VUC => Pass
4.0.0 (13:08:55): VUC endurance checks
  4.1.0 (13:08:55): prep VUC endurance tests
    4.1.1 (13:20:09): start stop guests (client) => Pass
    4.1.2 (14:39:40): add/remove ports (client) => Pass
  4.2.0 (14:49:14): Final cleanup

tags: added: verification-done verification-done-focal
removed: verification-needed verification-needed-focal
Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package dpdk - 20.11.3-0ubuntu0.21.04.2

---------------
dpdk (20.11.3-0ubuntu0.21.04.2) hirsute; urgency=medium

  * Skip flaky self-tests to make the tests more reliable (LP: #1939861)
    - d/p/disable_ppc64_autopkgtest_fails.patch: skip known false-positives
    - d/p/disable_armhf_autopkgtest_fails.patch: disable arm failures that do
      not represent regressions
    - d/p/disable_autopkgtest_fails.patch: disable failures that do not
      represent regressions
    - Add disable_lcores_autotest_ppc.patch to fix ppc64el autopkgtest

dpdk (20.11.3-0ubuntu0.21.04.1) hirsute; urgency=medium

  * Merge LTS stable release 20.11.3 (LP: #1940913)
    Release notes are available at:
    https://doc.dpdk.org/guides-20.11/rel_notes/release_20_11.html#id1
    - Remove test-catch-coredumps.patch [now part of upstream]
  * d/p/u/lp-1940957-net-i40e-support-25G-AOC-ACC-cables.patch: fix issues
    with 25G AOC cables (LP: #1940957)

 -- Christian Ehrhardt <email address hidden> Wed, 08 Sep 2021 09:00:48 +0200

Changed in dpdk (Ubuntu Hirsute):
status: Fix Committed → Fix Released
Revision history for this message
Brian Murray (brian-murray) wrote : Update Released

The verification of the Stable Release Update for dpdk has completed successfully and the package is now being released to -updates. Subsequently, the Ubuntu Stable Release Updates Team is being unsubscribed and will not receive messages about this bug report. In the event that you encounter a regression using the package from -updates please report a new bug using ubuntu-bug and tag the bug report regression-update so we can easily find any regressions.

Revision history for this message
Launchpad Janitor (janitor) wrote :

This bug was fixed in the package dpdk - 19.11.10-0ubuntu0.20.04.1

---------------
dpdk (19.11.10-0ubuntu0.20.04.1) focal; urgency=medium

  * Merge the latest upstream stable minor release 19.11.10 (LP: #1940913)
    Release notes available at:
    https://doc.dpdk.org/guides-19.11/rel_notes/release_19_11.html
    - Revert "fix linking back to pre be like 19.11.6 behavior (LP 1920141)"
      [now part of upstream]
  * d/p/u/lp-1940957-net-i40e-support-25G-AOC-ACC-cables.patch: fix issues
    with 25G AOC cables (LP: #1940957)

 -- Christian Ehrhardt <email address hidden> Tue, 24 Aug 2021 11:51:47 +0200

Changed in dpdk (Ubuntu Focal):
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.