Merge ~athos-ribeiro/ubuntu/+source/pglogical:increase-timeout into ubuntu/+source/pglogical:ubuntu/devel

Proposed by Athos Ribeiro
Status: Merged
Approved by: git-ubuntu bot
Approved revision: not available
Merge reported by: Athos Ribeiro
Merged at revision: b98026a767e01d71eb88ed075df4814a67584778
Proposed branch: ~athos-ribeiro/ubuntu/+source/pglogical:increase-timeout
Merge into: ubuntu/+source/pglogical:ubuntu/devel
Diff against target: 74 lines (+14/-5)
4 files modified
debian/changelog (+7/-0)
debian/control (+2/-1)
debian/control.in (+2/-1)
debian/patches/test_increase_timeouts.patch (+3/-3)
Reviewer Review Type Date Requested Status
git-ubuntu bot Approve
Sergio Durigan Junior (community) Approve
Canonical Server Reporter Pending
Review via email: mp+434570@code.launchpad.net

Description of the change

Increase timeout on flaky tests.

PPA: https://launchpad.net/~athos-ribeiro/+archive/ubuntu/pglogical-timeouts/+packages

Waiting for the PPA's dep8 test results.

To post a comment you must log in.
Revision history for this message
Sergio Durigan Junior (sergiodj) wrote :

Thanks for the MP, Athos.

Were you able to reproduce the failure locally? I spent a few hours last Friday trying to do so, but failed. At the time I thought the discrepancy could be caused by the fact that I'd rebuilt the package locally before running the tests, so I did a no-change upload in the hopes that it could make a difference, but unfortunately the test is still failing... I also built the package in a PPA, but it's hard to trigger the dep8 test using postgresql-15 as one of the triggers.

Anyway, I'm just curious to see if you were able to reproduce the failure and confirm that it's indeed a flaky test. Thanks!

review: Needs Information
Revision history for this message
Athos Ribeiro (athos-ribeiro) wrote :

Thanks, Sergio! All tests are passing with the new timeout:

https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/ppc64el/p/pglogical/20221213_201748_7c463@/log.gz

https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/armhf/p/pglogical/20221213_192348_d9e5a@/log.gz

https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/arm64/p/pglogical/20221213_201851_10806@/log.gz

https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/amd64/p/pglogical/20221213_202119_7a5cc@/log.gz

I could not reproduce it locally, but to ensure my PPA pg-15 build is not the variant fixing the test runs, I will revert the pglogical changes for the timeout values and verify they indeed fail (this, combined with the d/changelog entries and d/patches changing timeout values and disabling flaky tests should be enough to confirm this is a resources issue).

Revision history for this message
Sergio Durigan Junior (sergiodj) wrote :

On Tuesday, December 13 2022, Athos Ribeiro wrote:

> Thanks, Sergio! All tests are passing with the new timeout:
>
> https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/ppc64el/p/pglogical/20221213_201748_7c463@/log.gz
>
> https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/armhf/p/pglogical/20221213_192348_d9e5a@/log.gz
>
> https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/arm64/p/pglogical/20221213_201851_10806@/log.gz
>
> https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/amd64/p/pglogical/20221213_202119_7a5cc@/log.gz
>
> I could not reproduce it locally, but to ensure my PPA pg-15 build is
> not the variant fixing the test runs, I will revert the pglogical
> changes for the timeout values and verify they indeed fail (this,
> combined with the d/changelog entries and d/patches changing timeout
> values and disabling flaky tests should be enough to confirm this is a
> resources issue).

Thanks, Athos. That's great news :-). Let's wait and see what happens
with the reverted changes, then. But if you feel like going ahead and
uploading this to the archive directly, I wouldn't oppose.

Cheers,

--
Sergio
GPG key ID: E92F D0B3 6B14 F1F4 D8E0 EB2F 106D A1C8 C3CB BF14

Revision history for this message
Athos Ribeiro (athos-ribeiro) wrote (last edit ):

armhf passed, as the actual results we got in the archive: https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/armhf/p/pglogical/20221213_224806_7b1c5@/log.gz

amd64 and ppc64el failed, just as the actual results in the archive (same failure): https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/amd64/p/pglogical/20221213_233338_bf70c@/log.gz and https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/ppc64el/p/pglogical/20221213_234115_78ca0@/log.gz

differently from the results for the -proposed packages (and the tests above), arm64 passed after reverting the changes: https://autopkgtest.ubuntu.com/results/autopkgtest-lunar-athos-ribeiro-pglogical-timeouts/lunar/arm64/p/pglogical/20221214_002242_acdbf@/log.gz.

Still, considering the failures for ppc64el and amd64, these do seem to be flaky tests. IMO, we should merge and upload this. If the actual results are still flaky, we could proceed to disable this specific test.

Revision history for this message
Sergio Durigan Junior (sergiodj) wrote :

I guess that settles it, then. Thanks for the thorough investigation. SHIP IT!

review: Approve
Revision history for this message
git-ubuntu bot (git-ubuntu-bot) wrote :

Approvers: athos-ribeiro, sergiodj
Uploaders: athos-ribeiro, sergiodj
MP auto-approved

review: Approve
Revision history for this message
Athos Ribeiro (athos-ribeiro) wrote :

Thanks!

Uploaded

Uploading to ubuntu (via ftp to upload.ubuntu.com):
  Uploading pglogical_2.4.2-2ubuntu1.dsc: done.
  Uploading pglogical_2.4.2-2ubuntu1.debian.tar.xz: done.
  Uploading pglogical_2.4.2-2ubuntu1_source.buildinfo: done.
  Uploading pglogical_2.4.2-2ubuntu1_source.changes: done.
Successfully uploaded packages.

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1diff --git a/debian/changelog b/debian/changelog
2index ba6bf94..07be017 100644
3--- a/debian/changelog
4+++ b/debian/changelog
5@@ -1,3 +1,10 @@
6+pglogical (2.4.2-2ubuntu1) lunar; urgency=medium
7+
8+ * d/p/test_increase_timeouts.patch: increase timeout for flaky
9+ row_filter test.
10+
11+ -- Athos Ribeiro <athos.ribeiro@canonical.com> Tue, 13 Dec 2022 10:32:25 -0300
12+
13 pglogical (2.4.2-2build1) lunar; urgency=medium
14
15 * No-change rebuild to attempt migration.
16diff --git a/debian/control b/debian/control
17index a52a7b7..705920f 100644
18--- a/debian/control
19+++ b/debian/control
20@@ -1,7 +1,8 @@
21 Source: pglogical
22 Section: database
23 Priority: optional
24-Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
25+Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
26+XSBC-Original-Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
27 Uploaders: Michael Banck <michael.banck@credativ.de>, Marco Nenciarini <mnencia@debian.org>
28 Build-Depends:
29 debhelper-compat (= 13),
30diff --git a/debian/control.in b/debian/control.in
31index b2eb307..7366501 100644
32--- a/debian/control.in
33+++ b/debian/control.in
34@@ -1,7 +1,8 @@
35 Source: pglogical
36 Section: database
37 Priority: optional
38-Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
39+Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
40+XSBC-Original-Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
41 Uploaders: Michael Banck <michael.banck@credativ.de>, Marco Nenciarini <mnencia@debian.org>
42 Build-Depends:
43 debhelper-compat (= 13),
44diff --git a/debian/patches/test_increase_timeouts.patch b/debian/patches/test_increase_timeouts.patch
45index 55cb005..e596873 100644
46--- a/debian/patches/test_increase_timeouts.patch
47+++ b/debian/patches/test_increase_timeouts.patch
48@@ -59,7 +59,7 @@ Index: pglogical/sql/row_filter.sql
49 -- wait for the initial data to copy
50 BEGIN;
51 -SET LOCAL statement_timeout = '10s';
52-+SET LOCAL statement_timeout = '60s';
53++SET LOCAL statement_timeout = '120s';
54 SELECT pglogical.wait_for_subscription_sync_complete('test_subscription');
55 COMMIT;
56
57@@ -72,7 +72,7 @@ Index: pglogical/expected/row_filter.out
58 -- wait for the initial data to copy
59 BEGIN;
60 -SET LOCAL statement_timeout = '10s';
61-+SET LOCAL statement_timeout = '60s';
62++SET LOCAL statement_timeout = '120s';
63 SELECT pglogical.wait_for_subscription_sync_complete('test_subscription');
64 wait_for_subscription_sync_complete
65 -------------------------------------
66@@ -85,7 +85,7 @@ Index: pglogical/expected/row_filter_1.out
67 -- wait for the initial data to copy
68 BEGIN;
69 -SET LOCAL statement_timeout = '10s';
70-+SET LOCAL statement_timeout = '60s';
71++SET LOCAL statement_timeout = '120s';
72 SELECT pglogical.wait_for_subscription_sync_complete('test_subscription');
73 wait_for_subscription_sync_complete
74 -------------------------------------

Subscribers

People subscribed via source and target branches