Merge ~alexmurray/ubuntu-cve-tracker:die-partner-die into ubuntu-cve-tracker:master
- Git
- lp:~alexmurray/ubuntu-cve-tracker
- die-partner-die
- Merge into master
Status: | Merged |
---|---|
Merged at revision: | 058e1f911c7dd313a2f39b421ba1a5bf7c6148a7 |
Proposed branch: | ~alexmurray/ubuntu-cve-tracker:die-partner-die |
Merge into: | ubuntu-cve-tracker:master |
Diff against target: |
1051 lines (+105/-272) 16 files modified
.launchpad.yaml (+1/-3) README (+1/-5) scripts/check-syntax (+1/-4) scripts/cve-alert.sh (+1/-1) scripts/cve_lib.py (+38/-61) scripts/cve_packages (+3/-14) scripts/html-report (+3/-11) scripts/html/top/index.html (+0/-2) scripts/html/top/priority.html (+0/-1) scripts/html_export.py (+0/-1) scripts/monthly-report (+0/-3) scripts/packages-mirror (+50/-100) scripts/report-todo-numbers (+1/-6) scripts/report-todo-plot (+1/-1) scripts/source_map.py (+3/-48) scripts/ubuntu-table (+2/-11) |
Related bugs: |
Reviewer | Review Type | Date Requested | Status |
---|---|---|---|
Steve Beattie | Approve | ||
Marc Deslauriers | Approve | ||
Review via email:
|
Commit message
Description of the change
The partner mirror hasn't been used or supported for a very long time so let's not try and pretend anymore. Remove all references to it from UCT. Hopefully this fixes CI too since it seems the partner mirror is not available on the internal archive mirror either anymore for bionic since it went into ESM.
![](/+icing/build/overlay/assets/skins/sam/images/close.gif)
Marc Deslauriers (mdeslaur) wrote : | # |
![](/+icing/build/overlay/assets/skins/sam/images/close.gif)
Alex Murray (alexmurray) wrote : | # |
the global esm_warned was to fix pyflakes3 complaining about this variable - since I touched check-syntax pyflakes3 gets run against it in the pre-commit hook - this is needed to indicate we are using the global variable inside this function.
![](/+icing/build/overlay/assets/skins/sam/images/close.gif)
Marc Deslauriers (mdeslaur) wrote : | # |
> the global esm_warned was to fix pyflakes3 complaining about this variable -
> since I touched check-syntax pyflakes3 gets run against it in the pre-commit
> hook - this is needed to indicate we are using the global variable inside this
> function.
Ah! Great :)
![](/+icing/build/overlay/assets/skins/sam/images/close.gif)
Seth Arnold (seth-arnold) wrote : | # |
awesome :) thanks for tackling this!
![](/+icing/build/overlay/assets/skins/sam/images/close.gif)
Steve Beattie (sbeattie) wrote : | # |
Thanks! I also removed the setup for partner in the ubuntu-
This also fixes the current lpci check-syntax breakage, so yay!
Preview Diff
1 | diff --git a/.launchpad.yaml b/.launchpad.yaml | |||
2 | index cf00cb8..b2962f9 100644 | |||
3 | --- a/.launchpad.yaml | |||
4 | +++ b/.launchpad.yaml | |||
5 | @@ -59,9 +59,7 @@ jobs: | |||
6 | 59 | # for source_map | 59 | # for source_map |
7 | 60 | echo plb_authentication=/dev/null > ~/.ubuntu-cve-tracker.conf | 60 | echo plb_authentication=/dev/null > ~/.ubuntu-cve-tracker.conf |
8 | 61 | echo "packages_mirror=$HOME/mirrors/ubuntu/" >> ~/.ubuntu-cve-tracker.conf | 61 | echo "packages_mirror=$HOME/mirrors/ubuntu/" >> ~/.ubuntu-cve-tracker.conf |
12 | 62 | for mirror in debian partner; do | 62 | echo "debian_mirror=$HOME/mirrors/debian/" >> ~/.ubuntu-cve-tracker.conf |
10 | 63 | echo "${mirror}_mirror=$HOME/mirrors/${mirror}/" >> ~/.ubuntu-cve-tracker.conf | ||
11 | 64 | done | ||
13 | 65 | echo "Setting up packages-mirror..." | 63 | echo "Setting up packages-mirror..." |
14 | 66 | # use wget for packages-mirror since rsync is not accessible in lp | 64 | # use wget for packages-mirror since rsync is not accessible in lp |
15 | 67 | # builders - also invoke with -v since this seems to make downloading more | 65 | # builders - also invoke with -v since this seems to make downloading more |
16 | diff --git a/README b/README | |||
17 | index fc18a69..6603d53 100644 | |||
18 | --- a/README | |||
19 | +++ b/README | |||
20 | @@ -64,7 +64,6 @@ The following values need to be configured in ~/.ubuntu-cve-tracker.conf: | |||
21 | 64 | database (sis-generate-usn). | 64 | database (sis-generate-usn). |
22 | 65 | - usn_db_copy: path to copy of master USN database, used when creating | 65 | - usn_db_copy: path to copy of master USN database, used when creating |
23 | 66 | a template for a USN where "N" != 1 (sis-generate-usn). | 66 | a template for a USN where "N" != 1 (sis-generate-usn). |
24 | 67 | - partner_mirror: same as packages_mirror, but for the partner repo. | ||
25 | 68 | - debian_mirror: same as packages_mirror, but for Debian testing repo. | 67 | - debian_mirror: same as packages_mirror, but for Debian testing repo. |
26 | 69 | - mitre_loc: where to download the MITRE CVE database | 68 | - mitre_loc: where to download the MITRE CVE database |
27 | 70 | - nvd_loc: where to download the NVD database | 69 | - nvd_loc: where to download the NVD database |
28 | @@ -441,9 +440,6 @@ Show all active CVEs for supported (main) packages: | |||
29 | 441 | Number of active CVEs that are in main: | 440 | Number of active CVEs that are in main: |
30 | 442 | ./scripts/ubuntu-table --supported 2>/dev/null | grep SUPPORTED | wc -l | 441 | ./scripts/ubuntu-table --supported 2>/dev/null | grep SUPPORTED | wc -l |
31 | 443 | 442 | ||
32 | 444 | Show all active CVEs for partner packages: | ||
33 | 445 | ./scripts/ubuntu-table --supported 2>/dev/null | grep PARTNER | ||
34 | 446 | |||
35 | 447 | Show all out-of-sync CVEs for the devel release: | 443 | Show all out-of-sync CVEs for the devel release: |
36 | 448 | ./scripts/ubuntu-table --supported | grep 'out of sync' | awk '{if ($8 == "needed*" || $8 == "needs-triage*") { print $0 }}' | 444 | ./scripts/ubuntu-table --supported | grep 'out of sync' | awk '{if ($8 == "needed*" || $8 == "needs-triage*") { print $0 }}' |
37 | 449 | 445 | ||
38 | @@ -477,7 +473,7 @@ See all bugs with priority of medium or higher: | |||
39 | 477 | See a listing of packages with number of CVEs attached to them, weighted by | 473 | See a listing of packages with number of CVEs attached to them, weighted by |
40 | 478 | CVE priority: | 474 | CVE priority: |
41 | 479 | ./scripts/cve_packages | 475 | ./scripts/cve_packages |
43 | 480 | ./scripts/cve_packages -m (just supported (main, restricted and partner)) | 476 | ./scripts/cve_packages -m (just supported (main and restricted)) |
44 | 481 | ./scripts/cve_packages -u (just unsupported (universe and multiverse)) | 477 | ./scripts/cve_packages -u (just unsupported (universe and multiverse)) |
45 | 482 | ./scripts/cve_packages -t (just totals) | 478 | ./scripts/cve_packages -t (just totals) |
46 | 483 | ./scripts/cve_packages -a (with assignees) | 479 | ./scripts/cve_packages -a (with assignees) |
47 | diff --git a/scripts/check-syntax b/scripts/check-syntax | |||
48 | index 92c3606..9d701e3 100755 | |||
49 | --- a/scripts/check-syntax | |||
50 | +++ b/scripts/check-syntax | |||
51 | @@ -589,10 +589,6 @@ def check_cve(cve): | |||
52 | 589 | # Skip DNE's | 589 | # Skip DNE's |
53 | 590 | if state == "DNE": | 590 | if state == "DNE": |
54 | 591 | if pkg in source[rel]: | 591 | if pkg in source[rel]: |
55 | 592 | # TODO: remove this when partner archive is back in sync | ||
56 | 593 | # sigh, partner archive mirrors are out of date since removing sun-java6 | ||
57 | 594 | if pkg == "sun-java6" and source[rel][pkg]["section"] == "partner": | ||
58 | 595 | continue | ||
59 | 596 | print( | 592 | print( |
60 | 597 | "%s: %d: package '%s' DOES exist in '%s'" | 593 | "%s: %d: package '%s' DOES exist in '%s'" |
61 | 598 | % (filename, linenum, pkg, rel), | 594 | % (filename, linenum, pkg, rel), |
62 | @@ -685,6 +681,7 @@ def check_cve(cve): | |||
63 | 685 | released = details[1] | 681 | released = details[1] |
64 | 686 | # XXX 'version' existence check should not be needed | 682 | # XXX 'version' existence check should not be needed |
65 | 687 | if "version" not in source[rel][pkg]: | 683 | if "version" not in source[rel][pkg]: |
66 | 684 | global esm_warned | ||
67 | 688 | if not esm_warned: | 685 | if not esm_warned: |
68 | 689 | print( | 686 | print( |
69 | 690 | "%s: %d: unable to lookup source version for %s in %s" | 687 | "%s: %d: unable to lookup source version for %s in %s" |
70 | diff --git a/scripts/cve-alert.sh b/scripts/cve-alert.sh | |||
71 | index 417bc4c..84d761e 100755 | |||
72 | --- a/scripts/cve-alert.sh | |||
73 | +++ b/scripts/cve-alert.sh | |||
74 | @@ -9,7 +9,7 @@ set -e | |||
75 | 9 | alert_threshold=10 | 9 | alert_threshold=10 |
76 | 10 | alert_high_threshold=0 | 10 | alert_high_threshold=0 |
77 | 11 | alert_community_threshold=0 | 11 | alert_community_threshold=0 |
79 | 12 | alert_ignore="[[:blank:]]linux:|linux-lts-|linux-hwe|linux-ti-|linux-raspi|linux-snapdragon|linux-azure|linux-aws|linux-bluefield|linux-dell|linux-gcp|linux-gke|linux-ibm|linux-intel|linux-iot|linux-lowlatency|linux-kvm|linux-oem|linux-oracle|linux-riscv|linux-xilinx-zynqmp|qtwebkit-source|qtwebkit-opensource-src|webkit:|webkitgtk|oxide-qt|PARTNER" | 12 | alert_ignore="[[:blank:]]linux:|linux-lts-|linux-hwe|linux-ti-|linux-raspi|linux-snapdragon|linux-azure|linux-aws|linux-bluefield|linux-dell|linux-gcp|linux-gke|linux-ibm|linux-intel|linux-iot|linux-lowlatency|linux-kvm|linux-oem|linux-oracle|linux-riscv|linux-xilinx-zynqmp|qtwebkit-source|qtwebkit-opensource-src|webkit:|webkitgtk|oxide-qt" |
80 | 13 | alert_high_ignore="linux-hwe-edge:|linux-gcp-edge:|linux-azure-edge:" | 13 | alert_high_ignore="linux-hwe-edge:|linux-gcp-edge:|linux-azure-edge:" |
81 | 14 | # important universe packages that we'd like to have up to date | 14 | # important universe packages that we'd like to have up to date |
82 | 15 | alert_community="adobe-flashplugin|chromium-browser|docker\.io|flashplugin-nonfree" | 15 | alert_community="adobe-flashplugin|chromium-browser|docker\.io|flashplugin-nonfree" |
83 | diff --git a/scripts/cve_lib.py b/scripts/cve_lib.py | |||
84 | index 00d6075..4f5f7b8 100755 | |||
85 | --- a/scripts/cve_lib.py | |||
86 | +++ b/scripts/cve_lib.py | |||
87 | @@ -277,7 +277,7 @@ subprojects = { | |||
88 | 277 | }, | 277 | }, |
89 | 278 | "ubuntu/warty": { | 278 | "ubuntu/warty": { |
90 | 279 | "eol": True, | 279 | "eol": True, |
92 | 280 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 280 | "components": ["main", "restricted", "universe", "multiverse"], |
93 | 281 | "name": "Ubuntu 4.10", | 281 | "name": "Ubuntu 4.10", |
94 | 282 | "version": 4.10, | 282 | "version": 4.10, |
95 | 283 | "codename": "Warty Warthog", | 283 | "codename": "Warty Warthog", |
96 | @@ -287,7 +287,7 @@ subprojects = { | |||
97 | 287 | }, | 287 | }, |
98 | 288 | "ubuntu/hoary": { | 288 | "ubuntu/hoary": { |
99 | 289 | "eol": True, | 289 | "eol": True, |
101 | 290 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 290 | "components": ["main", "restricted", "universe", "multiverse"], |
102 | 291 | "name": "Ubuntu 5.04", | 291 | "name": "Ubuntu 5.04", |
103 | 292 | "version": 5.04, | 292 | "version": 5.04, |
104 | 293 | "codename": "Hoary Hedgehog", | 293 | "codename": "Hoary Hedgehog", |
105 | @@ -297,7 +297,7 @@ subprojects = { | |||
106 | 297 | }, | 297 | }, |
107 | 298 | "ubuntu/breezy": { | 298 | "ubuntu/breezy": { |
108 | 299 | "eol": True, | 299 | "eol": True, |
110 | 300 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 300 | "components": ["main", "restricted", "universe", "multiverse"], |
111 | 301 | "name": "Ubuntu 5.10", | 301 | "name": "Ubuntu 5.10", |
112 | 302 | "version": 5.10, | 302 | "version": 5.10, |
113 | 303 | "codename": "Breezy Badger", | 303 | "codename": "Breezy Badger", |
114 | @@ -307,7 +307,7 @@ subprojects = { | |||
115 | 307 | }, | 307 | }, |
116 | 308 | "ubuntu/dapper": { | 308 | "ubuntu/dapper": { |
117 | 309 | "eol": True, | 309 | "eol": True, |
119 | 310 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 310 | "components": ["main", "restricted", "universe", "multiverse"], |
120 | 311 | "name": "Ubuntu 6.06 LTS", | 311 | "name": "Ubuntu 6.06 LTS", |
121 | 312 | "version": 6.06, | 312 | "version": 6.06, |
122 | 313 | "codename": "Dapper Drake", | 313 | "codename": "Dapper Drake", |
123 | @@ -317,7 +317,7 @@ subprojects = { | |||
124 | 317 | }, | 317 | }, |
125 | 318 | "ubuntu/edgy": { | 318 | "ubuntu/edgy": { |
126 | 319 | "eol": True, | 319 | "eol": True, |
128 | 320 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 320 | "components": ["main", "restricted", "universe", "multiverse"], |
129 | 321 | "name": "Ubuntu 6.10", | 321 | "name": "Ubuntu 6.10", |
130 | 322 | "version": 6.10, | 322 | "version": 6.10, |
131 | 323 | "codename": "Edgy Eft", | 323 | "codename": "Edgy Eft", |
132 | @@ -327,7 +327,7 @@ subprojects = { | |||
133 | 327 | }, | 327 | }, |
134 | 328 | "ubuntu/feisty": { | 328 | "ubuntu/feisty": { |
135 | 329 | "eol": True, | 329 | "eol": True, |
137 | 330 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 330 | "components": ["main", "restricted", "universe", "multiverse"], |
138 | 331 | "name": "Ubuntu 7.04", | 331 | "name": "Ubuntu 7.04", |
139 | 332 | "version": 7.04, | 332 | "version": 7.04, |
140 | 333 | "codename": "Feisty Fawn", | 333 | "codename": "Feisty Fawn", |
141 | @@ -337,7 +337,7 @@ subprojects = { | |||
142 | 337 | }, | 337 | }, |
143 | 338 | "ubuntu/gutsy": { | 338 | "ubuntu/gutsy": { |
144 | 339 | "eol": True, | 339 | "eol": True, |
146 | 340 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 340 | "components": ["main", "restricted", "universe", "multiverse"], |
147 | 341 | "name": "Ubuntu 7.10", | 341 | "name": "Ubuntu 7.10", |
148 | 342 | "version": 7.10, | 342 | "version": 7.10, |
149 | 343 | "codename": "Gutsy Gibbon", | 343 | "codename": "Gutsy Gibbon", |
150 | @@ -347,7 +347,7 @@ subprojects = { | |||
151 | 347 | }, | 347 | }, |
152 | 348 | "ubuntu/hardy": { | 348 | "ubuntu/hardy": { |
153 | 349 | "eol": True, | 349 | "eol": True, |
155 | 350 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 350 | "components": ["main", "restricted", "universe", "multiverse"], |
156 | 351 | "name": "Ubuntu 8.04 LTS", | 351 | "name": "Ubuntu 8.04 LTS", |
157 | 352 | "version": 8.04, | 352 | "version": 8.04, |
158 | 353 | "codename": "Hardy Heron", | 353 | "codename": "Hardy Heron", |
159 | @@ -357,7 +357,7 @@ subprojects = { | |||
160 | 357 | }, | 357 | }, |
161 | 358 | "ubuntu/intrepid": { | 358 | "ubuntu/intrepid": { |
162 | 359 | "eol": True, | 359 | "eol": True, |
164 | 360 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 360 | "components": ["main", "restricted", "universe", "multiverse"], |
165 | 361 | "name": "Ubuntu 8.10", | 361 | "name": "Ubuntu 8.10", |
166 | 362 | "version": 8.10, | 362 | "version": 8.10, |
167 | 363 | "codename": "Intrepid Ibex", | 363 | "codename": "Intrepid Ibex", |
168 | @@ -367,7 +367,7 @@ subprojects = { | |||
169 | 367 | }, | 367 | }, |
170 | 368 | "ubuntu/jaunty": { | 368 | "ubuntu/jaunty": { |
171 | 369 | "eol": True, | 369 | "eol": True, |
173 | 370 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 370 | "components": ["main", "restricted", "universe", "multiverse"], |
174 | 371 | "name": "Ubuntu 9.04", | 371 | "name": "Ubuntu 9.04", |
175 | 372 | "version": 9.04, | 372 | "version": 9.04, |
176 | 373 | "codename": "Jaunty Jackalope", | 373 | "codename": "Jaunty Jackalope", |
177 | @@ -377,7 +377,7 @@ subprojects = { | |||
178 | 377 | }, | 377 | }, |
179 | 378 | "ubuntu/karmic": { | 378 | "ubuntu/karmic": { |
180 | 379 | "eol": True, | 379 | "eol": True, |
182 | 380 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 380 | "components": ["main", "restricted", "universe", "multiverse"], |
183 | 381 | "name": "Ubuntu 9.10", | 381 | "name": "Ubuntu 9.10", |
184 | 382 | "version": 9.10, | 382 | "version": 9.10, |
185 | 383 | "codename": "Karmic Koala", | 383 | "codename": "Karmic Koala", |
186 | @@ -387,7 +387,7 @@ subprojects = { | |||
187 | 387 | }, | 387 | }, |
188 | 388 | "ubuntu/lucid": { | 388 | "ubuntu/lucid": { |
189 | 389 | "eol": True, | 389 | "eol": True, |
191 | 390 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 390 | "components": ["main", "restricted", "universe", "multiverse"], |
192 | 391 | "name": "Ubuntu 10.04 LTS", | 391 | "name": "Ubuntu 10.04 LTS", |
193 | 392 | "version": 10.04, | 392 | "version": 10.04, |
194 | 393 | "codename": "Lucid Lynx", | 393 | "codename": "Lucid Lynx", |
195 | @@ -397,7 +397,7 @@ subprojects = { | |||
196 | 397 | }, | 397 | }, |
197 | 398 | "ubuntu/maverick": { | 398 | "ubuntu/maverick": { |
198 | 399 | "eol": True, | 399 | "eol": True, |
200 | 400 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 400 | "components": ["main", "restricted", "universe", "multiverse"], |
201 | 401 | "name": "Ubuntu 10.10", | 401 | "name": "Ubuntu 10.10", |
202 | 402 | "version": 10.10, | 402 | "version": 10.10, |
203 | 403 | "codename": "Maverick Meerkat", | 403 | "codename": "Maverick Meerkat", |
204 | @@ -407,7 +407,7 @@ subprojects = { | |||
205 | 407 | }, | 407 | }, |
206 | 408 | "ubuntu/natty": { | 408 | "ubuntu/natty": { |
207 | 409 | "eol": True, | 409 | "eol": True, |
209 | 410 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 410 | "components": ["main", "restricted", "universe", "multiverse"], |
210 | 411 | "name": "Ubuntu 11.04", | 411 | "name": "Ubuntu 11.04", |
211 | 412 | "version": 11.04, | 412 | "version": 11.04, |
212 | 413 | "codename": "Natty Narwhal", | 413 | "codename": "Natty Narwhal", |
213 | @@ -417,7 +417,7 @@ subprojects = { | |||
214 | 417 | }, | 417 | }, |
215 | 418 | "ubuntu/oneiric": { | 418 | "ubuntu/oneiric": { |
216 | 419 | "eol": True, | 419 | "eol": True, |
218 | 420 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 420 | "components": ["main", "restricted", "universe", "multiverse"], |
219 | 421 | "name": "Ubuntu 11.10", | 421 | "name": "Ubuntu 11.10", |
220 | 422 | "version": 11.10, | 422 | "version": 11.10, |
221 | 423 | "codename": "Oneiric Ocelot", | 423 | "codename": "Oneiric Ocelot", |
222 | @@ -427,7 +427,7 @@ subprojects = { | |||
223 | 427 | }, | 427 | }, |
224 | 428 | "ubuntu/precise": { | 428 | "ubuntu/precise": { |
225 | 429 | "eol": True, | 429 | "eol": True, |
227 | 430 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 430 | "components": ["main", "restricted", "universe", "multiverse"], |
228 | 431 | "name": "Ubuntu 12.04 LTS", | 431 | "name": "Ubuntu 12.04 LTS", |
229 | 432 | "version": 12.04, | 432 | "version": 12.04, |
230 | 433 | "codename": "Precise Pangolin", | 433 | "codename": "Precise Pangolin", |
231 | @@ -437,7 +437,7 @@ subprojects = { | |||
232 | 437 | }, | 437 | }, |
233 | 438 | "ubuntu/quantal": { | 438 | "ubuntu/quantal": { |
234 | 439 | "eol": True, | 439 | "eol": True, |
236 | 440 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 440 | "components": ["main", "restricted", "universe", "multiverse"], |
237 | 441 | "name": "Ubuntu 12.10", | 441 | "name": "Ubuntu 12.10", |
238 | 442 | "version": 12.10, | 442 | "version": 12.10, |
239 | 443 | "codename": "Quantal Quetzal", | 443 | "codename": "Quantal Quetzal", |
240 | @@ -447,7 +447,7 @@ subprojects = { | |||
241 | 447 | }, | 447 | }, |
242 | 448 | "ubuntu/raring": { | 448 | "ubuntu/raring": { |
243 | 449 | "eol": True, | 449 | "eol": True, |
245 | 450 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 450 | "components": ["main", "restricted", "universe", "multiverse"], |
246 | 451 | "name": "Ubuntu 13.04", | 451 | "name": "Ubuntu 13.04", |
247 | 452 | "version": 13.04, | 452 | "version": 13.04, |
248 | 453 | "codename": "Raring Ringtail", | 453 | "codename": "Raring Ringtail", |
249 | @@ -457,7 +457,7 @@ subprojects = { | |||
250 | 457 | }, | 457 | }, |
251 | 458 | "ubuntu/saucy": { | 458 | "ubuntu/saucy": { |
252 | 459 | "eol": True, | 459 | "eol": True, |
254 | 460 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 460 | "components": ["main", "restricted", "universe", "multiverse"], |
255 | 461 | "name": "Ubuntu 13.10", | 461 | "name": "Ubuntu 13.10", |
256 | 462 | "version": 13.10, | 462 | "version": 13.10, |
257 | 463 | "codename": "Saucy Salamander", | 463 | "codename": "Saucy Salamander", |
258 | @@ -467,7 +467,7 @@ subprojects = { | |||
259 | 467 | }, | 467 | }, |
260 | 468 | "ubuntu/trusty": { | 468 | "ubuntu/trusty": { |
261 | 469 | "eol": True, | 469 | "eol": True, |
263 | 470 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 470 | "components": ["main", "restricted", "universe", "multiverse"], |
264 | 471 | "name": "Ubuntu 14.04 LTS", | 471 | "name": "Ubuntu 14.04 LTS", |
265 | 472 | "version": 14.04, | 472 | "version": 14.04, |
266 | 473 | "codename": "Trusty Tahr", | 473 | "codename": "Trusty Tahr", |
267 | @@ -477,7 +477,7 @@ subprojects = { | |||
268 | 477 | }, | 477 | }, |
269 | 478 | "ubuntu/utopic": { | 478 | "ubuntu/utopic": { |
270 | 479 | "eol": True, | 479 | "eol": True, |
272 | 480 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 480 | "components": ["main", "restricted", "universe", "multiverse"], |
273 | 481 | "name": "Ubuntu 14.10", | 481 | "name": "Ubuntu 14.10", |
274 | 482 | "version": 14.10, | 482 | "version": 14.10, |
275 | 483 | "codename": "Utopic Unicorn", | 483 | "codename": "Utopic Unicorn", |
276 | @@ -487,7 +487,7 @@ subprojects = { | |||
277 | 487 | }, | 487 | }, |
278 | 488 | "ubuntu/vivid": { | 488 | "ubuntu/vivid": { |
279 | 489 | "eol": True, | 489 | "eol": True, |
281 | 490 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 490 | "components": ["main", "restricted", "universe", "multiverse"], |
282 | 491 | "name": "Ubuntu 15.04", | 491 | "name": "Ubuntu 15.04", |
283 | 492 | "version": 15.04, | 492 | "version": 15.04, |
284 | 493 | "codename": "Vivid Vervet", | 493 | "codename": "Vivid Vervet", |
285 | @@ -497,7 +497,7 @@ subprojects = { | |||
286 | 497 | }, | 497 | }, |
287 | 498 | "ubuntu/wily": { | 498 | "ubuntu/wily": { |
288 | 499 | "eol": True, | 499 | "eol": True, |
290 | 500 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 500 | "components": ["main", "restricted", "universe", "multiverse"], |
291 | 501 | "name": "Ubuntu 15.10", | 501 | "name": "Ubuntu 15.10", |
292 | 502 | "version": 15.10, | 502 | "version": 15.10, |
293 | 503 | "codename": "Wily Werewolf", | 503 | "codename": "Wily Werewolf", |
294 | @@ -507,7 +507,7 @@ subprojects = { | |||
295 | 507 | }, | 507 | }, |
296 | 508 | "ubuntu/xenial": { | 508 | "ubuntu/xenial": { |
297 | 509 | "eol": True, | 509 | "eol": True, |
299 | 510 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 510 | "components": ["main", "restricted", "universe", "multiverse"], |
300 | 511 | "name": "Ubuntu 16.04 LTS", | 511 | "name": "Ubuntu 16.04 LTS", |
301 | 512 | "version": 16.04, | 512 | "version": 16.04, |
302 | 513 | "codename": "Xenial Xerus", | 513 | "codename": "Xenial Xerus", |
303 | @@ -517,7 +517,7 @@ subprojects = { | |||
304 | 517 | }, | 517 | }, |
305 | 518 | "ubuntu/yakkety": { | 518 | "ubuntu/yakkety": { |
306 | 519 | "eol": True, | 519 | "eol": True, |
308 | 520 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 520 | "components": ["main", "restricted", "universe", "multiverse"], |
309 | 521 | "name": "Ubuntu 16.10", | 521 | "name": "Ubuntu 16.10", |
310 | 522 | "version": 16.10, | 522 | "version": 16.10, |
311 | 523 | "codename": "Yakkety Yak", | 523 | "codename": "Yakkety Yak", |
312 | @@ -527,7 +527,7 @@ subprojects = { | |||
313 | 527 | }, | 527 | }, |
314 | 528 | "ubuntu/zesty": { | 528 | "ubuntu/zesty": { |
315 | 529 | "eol": True, | 529 | "eol": True, |
317 | 530 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 530 | "components": ["main", "restricted", "universe", "multiverse"], |
318 | 531 | "name": "Ubuntu 17.04", | 531 | "name": "Ubuntu 17.04", |
319 | 532 | "version": 17.04, | 532 | "version": 17.04, |
320 | 533 | "codename": "Zesty Zapus", | 533 | "codename": "Zesty Zapus", |
321 | @@ -537,7 +537,7 @@ subprojects = { | |||
322 | 537 | }, | 537 | }, |
323 | 538 | "ubuntu/artful": { | 538 | "ubuntu/artful": { |
324 | 539 | "eol": True, | 539 | "eol": True, |
326 | 540 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 540 | "components": ["main", "restricted", "universe", "multiverse"], |
327 | 541 | "name": "Ubuntu 17.10", | 541 | "name": "Ubuntu 17.10", |
328 | 542 | "version": 17.10, | 542 | "version": 17.10, |
329 | 543 | "codename": "Artful Aardvark", | 543 | "codename": "Artful Aardvark", |
330 | @@ -548,7 +548,7 @@ subprojects = { | |||
331 | 548 | "ubuntu/bionic": { | 548 | "ubuntu/bionic": { |
332 | 549 | "eol": True, | 549 | "eol": True, |
333 | 550 | "oval": True, | 550 | "oval": True, |
335 | 551 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 551 | "components": ["main", "restricted", "universe", "multiverse"], |
336 | 552 | "name": "Ubuntu 18.04 LTS", | 552 | "name": "Ubuntu 18.04 LTS", |
337 | 553 | "version": 18.04, | 553 | "version": 18.04, |
338 | 554 | "codename": "Bionic Beaver", | 554 | "codename": "Bionic Beaver", |
339 | @@ -558,7 +558,7 @@ subprojects = { | |||
340 | 558 | }, | 558 | }, |
341 | 559 | "ubuntu/cosmic": { | 559 | "ubuntu/cosmic": { |
342 | 560 | "eol": True, | 560 | "eol": True, |
344 | 561 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 561 | "components": ["main", "restricted", "universe", "multiverse"], |
345 | 562 | "name": "Ubuntu 18.10", | 562 | "name": "Ubuntu 18.10", |
346 | 563 | "version": 18.10, | 563 | "version": 18.10, |
347 | 564 | "codename": "Cosmic Cuttlefish", | 564 | "codename": "Cosmic Cuttlefish", |
348 | @@ -568,7 +568,7 @@ subprojects = { | |||
349 | 568 | }, | 568 | }, |
350 | 569 | "ubuntu/disco": { | 569 | "ubuntu/disco": { |
351 | 570 | "eol": True, | 570 | "eol": True, |
353 | 571 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 571 | "components": ["main", "restricted", "universe", "multiverse"], |
354 | 572 | "name": "Ubuntu 19.04", | 572 | "name": "Ubuntu 19.04", |
355 | 573 | "version": 19.04, | 573 | "version": 19.04, |
356 | 574 | "codename": "Disco Dingo", | 574 | "codename": "Disco Dingo", |
357 | @@ -578,7 +578,7 @@ subprojects = { | |||
358 | 578 | }, | 578 | }, |
359 | 579 | "ubuntu/eoan": { | 579 | "ubuntu/eoan": { |
360 | 580 | "eol": True, | 580 | "eol": True, |
362 | 581 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 581 | "components": ["main", "restricted", "universe", "multiverse"], |
363 | 582 | "name": "Ubuntu 19.10", | 582 | "name": "Ubuntu 19.10", |
364 | 583 | "version": 19.10, | 583 | "version": 19.10, |
365 | 584 | "codename": "Eoan Ermine", | 584 | "codename": "Eoan Ermine", |
366 | @@ -589,7 +589,7 @@ subprojects = { | |||
367 | 589 | "ubuntu/focal": { | 589 | "ubuntu/focal": { |
368 | 590 | "eol": False, | 590 | "eol": False, |
369 | 591 | "oval": True, | 591 | "oval": True, |
371 | 592 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 592 | "components": ["main", "restricted", "universe", "multiverse"], |
372 | 593 | "name": "Ubuntu 20.04 LTS", | 593 | "name": "Ubuntu 20.04 LTS", |
373 | 594 | "version": 20.04, | 594 | "version": 20.04, |
374 | 595 | "codename": "Focal Fossa", | 595 | "codename": "Focal Fossa", |
375 | @@ -599,7 +599,7 @@ subprojects = { | |||
376 | 599 | }, | 599 | }, |
377 | 600 | "ubuntu/groovy": { | 600 | "ubuntu/groovy": { |
378 | 601 | "eol": True, | 601 | "eol": True, |
380 | 602 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 602 | "components": ["main", "restricted", "universe", "multiverse"], |
381 | 603 | "name": "Ubuntu 20.10", | 603 | "name": "Ubuntu 20.10", |
382 | 604 | "version": 20.10, | 604 | "version": 20.10, |
383 | 605 | "codename": "Groovy Gorilla", | 605 | "codename": "Groovy Gorilla", |
384 | @@ -609,7 +609,7 @@ subprojects = { | |||
385 | 609 | }, | 609 | }, |
386 | 610 | "ubuntu/hirsute": { | 610 | "ubuntu/hirsute": { |
387 | 611 | "eol": True, | 611 | "eol": True, |
389 | 612 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 612 | "components": ["main", "restricted", "universe", "multiverse"], |
390 | 613 | "name": "Ubuntu 21.04", | 613 | "name": "Ubuntu 21.04", |
391 | 614 | "version": 21.04, | 614 | "version": 21.04, |
392 | 615 | "codename": "Hirsute Hippo", | 615 | "codename": "Hirsute Hippo", |
393 | @@ -619,7 +619,7 @@ subprojects = { | |||
394 | 619 | }, | 619 | }, |
395 | 620 | "ubuntu/impish": { | 620 | "ubuntu/impish": { |
396 | 621 | "eol": True, | 621 | "eol": True, |
398 | 622 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 622 | "components": ["main", "restricted", "universe", "multiverse"], |
399 | 623 | "name": "Ubuntu 21.10", | 623 | "name": "Ubuntu 21.10", |
400 | 624 | "version": 21.10, | 624 | "version": 21.10, |
401 | 625 | "codename": "Impish Indri", | 625 | "codename": "Impish Indri", |
402 | @@ -630,7 +630,7 @@ subprojects = { | |||
403 | 630 | "ubuntu/jammy": { | 630 | "ubuntu/jammy": { |
404 | 631 | "eol": False, | 631 | "eol": False, |
405 | 632 | "oval": True, | 632 | "oval": True, |
407 | 633 | "components": ["main", "restricted", "universe", "multiverse", "partner"], | 633 | "components": ["main", "restricted", "universe", "multiverse"], |
408 | 634 | "name": "Ubuntu 22.04 LTS", | 634 | "name": "Ubuntu 22.04 LTS", |
409 | 635 | "version": 22.04, | 635 | "version": 22.04, |
410 | 636 | "codename": "Jammy Jellyfish", | 636 | "codename": "Jammy Jellyfish", |
411 | @@ -2572,21 +2572,8 @@ def any_supported(map, pkg, releases, cvedata): | |||
412 | 2572 | return False | 2572 | return False |
413 | 2573 | 2573 | ||
414 | 2574 | 2574 | ||
415 | 2575 | def is_partner(map, pkg, rel): | ||
416 | 2576 | if rel in map and pkg in map[rel] and map[rel][pkg]['section'] == 'partner': | ||
417 | 2577 | return True | ||
418 | 2578 | return False | ||
419 | 2579 | |||
420 | 2580 | |||
421 | 2581 | def any_partner(map, pkg, releases): | ||
422 | 2582 | for rel in releases: | ||
423 | 2583 | if is_partner(map, pkg, rel): | ||
424 | 2584 | return True | ||
425 | 2585 | return False | ||
426 | 2586 | |||
427 | 2587 | |||
428 | 2588 | def is_universe(map, pkg, rel, cvedata): | 2575 | def is_universe(map, pkg, rel, cvedata): |
430 | 2589 | if is_supported(map, pkg, rel, cvedata) or is_partner(map, pkg, rel): | 2576 | if is_supported(map, pkg, rel, cvedata): |
431 | 2590 | return False | 2577 | return False |
432 | 2591 | return True | 2578 | return True |
433 | 2592 | 2579 | ||
434 | @@ -2598,14 +2585,6 @@ def any_universe(map, pkg, releases, cvedata): | |||
435 | 2598 | return False | 2585 | return False |
436 | 2599 | 2586 | ||
437 | 2600 | 2587 | ||
438 | 2601 | def release_has_partner(rel): | ||
439 | 2602 | try: | ||
440 | 2603 | _,_,_,details = get_subproject_details(rel) | ||
441 | 2604 | return "partner" in details["components"] | ||
442 | 2605 | except (ValueError, KeyError): | ||
443 | 2606 | return False | ||
444 | 2607 | |||
445 | 2608 | |||
446 | 2609 | def in_universe(map, pkg, rel, cve, cvedata): | 2588 | def in_universe(map, pkg, rel, cve, cvedata): |
447 | 2610 | if pkg in map[rel] and map[rel][pkg]['section'] == 'universe': | 2589 | if pkg in map[rel] and map[rel][pkg]['section'] == 'universe': |
448 | 2611 | return True | 2590 | return True |
449 | @@ -3008,7 +2987,7 @@ def git_delete_branch(branch, debug=False): | |||
450 | 3008 | # cve_lib.check_mirror_timestamp(config) | 2987 | # cve_lib.check_mirror_timestamp(config) |
451 | 3009 | # cve_lib.check_mirror_timestamp(config, mirror='packages_mirror') | 2988 | # cve_lib.check_mirror_timestamp(config, mirror='packages_mirror') |
452 | 3010 | def check_mirror_timestamp(config, mirror=None): | 2989 | def check_mirror_timestamp(config, mirror=None): |
454 | 3011 | mirrors = ['packages_mirror', 'partner_mirror'] | 2990 | mirrors = ['packages_mirror'] |
455 | 3012 | if mirror is not None: | 2991 | if mirror is not None: |
456 | 3013 | mirrors = [mirror] | 2992 | mirrors = [mirror] |
457 | 3014 | for m in mirrors: | 2993 | for m in mirrors: |
458 | @@ -3017,8 +2996,6 @@ def check_mirror_timestamp(config, mirror=None): | |||
459 | 3017 | a = config[m] | 2996 | a = config[m] |
460 | 3018 | 2997 | ||
461 | 3019 | secs = 86400 | 2998 | secs = 86400 |
462 | 3020 | if m == 'partner_mirror': | ||
463 | 3021 | secs = secs * 7 | ||
464 | 3022 | 2999 | ||
465 | 3023 | if os.path.exists(a + ".timestamp") and time.mktime(time.localtime()) - os.stat(a + ".timestamp").st_mtime > secs: | 3000 | if os.path.exists(a + ".timestamp") and time.mktime(time.localtime()) - os.stat(a + ".timestamp").st_mtime > secs: |
466 | 3024 | print("WARNING: '%s' is %1.1f days older than %1.1f day(s). Please run '$UCT/scripts/packages-mirror -t'." % | 3001 | print("WARNING: '%s' is %1.1f days older than %1.1f day(s). Please run '$UCT/scripts/packages-mirror -t'." % |
467 | diff --git a/scripts/cve_packages b/scripts/cve_packages | |||
468 | index d301464..da038c4 100755 | |||
469 | --- a/scripts/cve_packages | |||
470 | +++ b/scripts/cve_packages | |||
471 | @@ -86,7 +86,6 @@ deferred_packages = dict() | |||
472 | 86 | popularity = dict() | 86 | popularity = dict() |
473 | 87 | pockets = { 'supported' : dict(), | 87 | pockets = { 'supported' : dict(), |
474 | 88 | 'universe' : dict(), | 88 | 'universe' : dict(), |
475 | 89 | 'partner' : dict(), | ||
476 | 90 | 'only_in_supported_overlay' : dict() } | 89 | 'only_in_supported_overlay' : dict() } |
477 | 91 | 90 | ||
478 | 92 | points = { 'negligible' : 0, | 91 | points = { 'negligible' : 0, |
479 | @@ -175,7 +174,6 @@ for cve in sorted(cves): | |||
480 | 175 | continue | 174 | continue |
481 | 176 | 175 | ||
482 | 177 | supported = False | 176 | supported = False |
483 | 178 | partner = False | ||
484 | 179 | universe = False | 177 | universe = False |
485 | 180 | found = False | 178 | found = False |
486 | 181 | overlay = False | 179 | overlay = False |
487 | @@ -219,18 +217,16 @@ for cve in sorted(cves): | |||
488 | 219 | found = True | 217 | found = True |
489 | 220 | if cve_lib.is_supported(map, namemap[pkg][r], r, cveinfo[cve]): | 218 | if cve_lib.is_supported(map, namemap[pkg][r], r, cveinfo[cve]): |
490 | 221 | supported = True | 219 | supported = True |
491 | 222 | if cve_lib.is_partner(map, namemap[pkg][r], r): | ||
492 | 223 | partner = True | ||
493 | 224 | if cve_lib.is_universe(map, namemap[pkg][r], r, cveinfo[cve]): | 220 | if cve_lib.is_universe(map, namemap[pkg][r], r, cveinfo[cve]): |
494 | 225 | universe = True | 221 | universe = True |
495 | 226 | 222 | ||
496 | 227 | if not found: | 223 | if not found: |
497 | 228 | continue | 224 | continue |
498 | 229 | 225 | ||
500 | 230 | if opt.only_supported and not supported and not partner: | 226 | if opt.only_supported and not supported: |
501 | 231 | continue | 227 | continue |
502 | 232 | 228 | ||
504 | 233 | if opt.not_supported and (supported or partner): | 229 | if opt.not_supported and supported: |
505 | 234 | continue | 230 | continue |
506 | 235 | 231 | ||
507 | 236 | if supported: | 232 | if supported: |
508 | @@ -245,11 +241,6 @@ for cve in sorted(cves): | |||
509 | 245 | else: | 241 | else: |
510 | 246 | pockets['only_in_supported_overlay'][pkg] = 1 | 242 | pockets['only_in_supported_overlay'][pkg] = 1 |
511 | 247 | 243 | ||
512 | 248 | if partner: | ||
513 | 249 | if pkg in pockets['partner']: | ||
514 | 250 | pockets['partner'][pkg] += 1 | ||
515 | 251 | else: | ||
516 | 252 | pockets['partner'][pkg] = 1 | ||
517 | 253 | if universe: | 244 | if universe: |
518 | 254 | if pkg in pockets['universe']: | 245 | if pkg in pockets['universe']: |
519 | 255 | pockets['universe'][pkg] += 1 | 246 | pockets['universe'][pkg] += 1 |
520 | @@ -409,9 +400,7 @@ else: | |||
521 | 409 | sys.stdout.write(", %s %s" % (str(priorities[p][pkg]), p)) | 400 | sys.stdout.write(", %s %s" % (str(priorities[p][pkg]), p)) |
522 | 410 | 401 | ||
523 | 411 | extra_info = [] | 402 | extra_info = [] |
527 | 412 | if pkg in pockets['partner']: | 403 | if pkg in pockets['supported']: |
525 | 413 | extra_info.append('PARTNER') | ||
526 | 414 | elif pkg in pockets['supported']: | ||
528 | 415 | if pkg in pockets['only_in_supported_overlay']: | 404 | if pkg in pockets['only_in_supported_overlay']: |
529 | 416 | extra_info.append('SUPPORTED-ONLY-OVERLAY') | 405 | extra_info.append('SUPPORTED-ONLY-OVERLAY') |
530 | 417 | else: | 406 | else: |
531 | diff --git a/scripts/html-report b/scripts/html-report | |||
532 | index 63a15a5..70ea75c 100755 | |||
533 | --- a/scripts/html-report | |||
534 | +++ b/scripts/html-report | |||
535 | @@ -80,14 +80,11 @@ header() { | |||
536 | 80 | show="$2" | 80 | show="$2" |
537 | 81 | main_active="" | 81 | main_active="" |
538 | 82 | universe_active="" | 82 | universe_active="" |
539 | 83 | partner_active="" | ||
540 | 84 | 83 | ||
541 | 85 | if [ "$show" = "main" ]; then | 84 | if [ "$show" = "main" ]; then |
542 | 86 | main_active="active "; | 85 | main_active="active "; |
543 | 87 | elif [ "$show" = "universe" ]; then | 86 | elif [ "$show" = "universe" ]; then |
544 | 88 | universe_active="active "; | 87 | universe_active="active "; |
545 | 89 | elif [ "$show" = "partner" ]; then | ||
546 | 90 | partner_active="active "; | ||
547 | 91 | fi | 88 | fi |
548 | 92 | 89 | ||
549 | 93 | cat > "$outfile" <<EOM | 90 | cat > "$outfile" <<EOM |
550 | @@ -129,7 +126,6 @@ header() { | |||
551 | 129 | <li class="nav-item"><a class="nav-link" href=".">Home</a></li> | 126 | <li class="nav-item"><a class="nav-link" href=".">Home</a></li> |
552 | 130 | <li class="nav-item"><a class="${main_active}nav-link" href="main.html">Main</a></li> | 127 | <li class="nav-item"><a class="${main_active}nav-link" href="main.html">Main</a></li> |
553 | 131 | <li class="nav-item"><a class="${universe_active}nav-link" href="universe.html">Universe</a></li> | 128 | <li class="nav-item"><a class="${universe_active}nav-link" href="universe.html">Universe</a></li> |
554 | 132 | <li class="nav-item"><a class="${partner_active}nav-link" href="partner.html">Partner</a></li> | ||
555 | 133 | </ul> | 129 | </ul> |
556 | 134 | </div><!--/.nav-collapse --> | 130 | </div><!--/.nav-collapse --> |
557 | 135 | </nav> | 131 | </nav> |
558 | @@ -152,7 +148,6 @@ This report is divided into the following sections:</p> | |||
559 | 152 | <ul class="style-none text-left"> | 148 | <ul class="style-none text-left"> |
560 | 153 | <li><a href="main${suffix}.html">Main</a> (supported by Canonical Ltd)</li> | 149 | <li><a href="main${suffix}.html">Main</a> (supported by Canonical Ltd)</li> |
561 | 154 | <li><a href="universe${suffix}.html">Universe</a> (supported by the Ubuntu community)</li> | 150 | <li><a href="universe${suffix}.html">Universe</a> (supported by the Ubuntu community)</li> |
562 | 155 | <li><a href="partner${suffix}.html">Partner</a> (supported by upstream vendor)</li> | ||
563 | 156 | </ul> | 151 | </ul> |
564 | 157 | 152 | ||
565 | 158 | <p class="text-left">See <a href="priority.html">Priority Color Key</a> for information about the significance of the colors on this page.</p> | 153 | <p class="text-left">See <a href="priority.html">Priority Color Key</a> for information about the significance of the colors on this page.</p> |
566 | @@ -210,8 +205,8 @@ EOM | |||
567 | 210 | } | 205 | } |
568 | 211 | 206 | ||
569 | 212 | OUTPUT=$($ubuntu_table_exe --html --supported --no-retired $table_args) | 207 | OUTPUT=$($ubuntu_table_exe --html --supported --no-retired $table_args) |
572 | 213 | #for show in main universe partner index | 208 | #for show in main universe index |
573 | 214 | for show in main universe partner | 209 | for show in main universe |
574 | 215 | do | 210 | do |
575 | 216 | outfile="${tmpdir}/${show}${suffix}.html" | 211 | outfile="${tmpdir}/${show}${suffix}.html" |
576 | 217 | header "$outfile" "$show" | 212 | header "$outfile" "$show" |
577 | @@ -224,11 +219,8 @@ do | |||
578 | 224 | echo "<p class='note text-right'>* supported by Canonical Ltd</p>" >> "$outfile" | 219 | echo "<p class='note text-right'>* supported by Canonical Ltd</p>" >> "$outfile" |
579 | 225 | elif [ "$show" = "universe" ]; then | 220 | elif [ "$show" = "universe" ]; then |
580 | 226 | echo "<h3 class=\"text-center\">Universe</h3>" >> "$outfile" | 221 | echo "<h3 class=\"text-center\">Universe</h3>" >> "$outfile" |
582 | 227 | echo "$OUTPUT" | egrep '(<table id="cves".*>|</table>|<thead.*>|</thead>|<tbody>|<tbody>|<th>|UNIVERSE)' | egrep -v 'PARTNER' | egrep -v "$embargoed" | sed -r 's#<td>[[:space:]]+(<p>[[:space:]]*[a-zA-Z0-9\-]*[[:space:]]*</p>[[:space:]]+)+</td>[[:space:]]+</tr>$#</tr>#' | sed -r 's#<th>Notes</th></tr>$#</tr>#' >> "$outfile" | 222 | echo "$OUTPUT" | egrep '(<table id="cves".*>|</table>|<thead.*>|</thead>|<tbody>|<tbody>|<th>|UNIVERSE)' | egrep -v "$embargoed" | sed -r 's#<td>[[:space:]]+(<p>[[:space:]]*[a-zA-Z0-9\-]*[[:space:]]*</p>[[:space:]]+)+</td>[[:space:]]+</tr>$#</tr>#' | sed -r 's#<th>Notes</th></tr>$#</tr>#' >> "$outfile" |
583 | 228 | echo "<p class='note text-right'>* supported by Canonical Ltd</p>" >> "$outfile" | 223 | echo "<p class='note text-right'>* supported by Canonical Ltd</p>" >> "$outfile" |
584 | 229 | elif [ "$show" = "partner" ]; then | ||
585 | 230 | echo "<h3 class=\"text-center\">Partner</h3>" >> "$outfile" | ||
586 | 231 | echo "$OUTPUT" | egrep '(<table id="cves".*>|</table>|<thead.*>|</thead>|<tbody>|<tbody>|<th>|PARTNER)' | egrep -v "$embargoed"| sed -r 's#<td>[[:space:]]+(<p>[[:space:]]*[a-zA-Z0-9\-]*[[:space:]]*</p>[[:space:]]+)+</td>[[:space:]]+</tr>$#</tr>#' | sed -r 's#<th>Notes</th></tr>$#</tr>#' >> "$outfile" | ||
587 | 232 | fi | 224 | fi |
588 | 233 | 225 | ||
589 | 234 | footer "$outfile" | 226 | footer "$outfile" |
590 | diff --git a/scripts/html/top/index.html b/scripts/html/top/index.html | |||
591 | index 34047fd..e68dea1 100644 | |||
592 | --- a/scripts/html/top/index.html | |||
593 | +++ b/scripts/html/top/index.html | |||
594 | @@ -53,7 +53,6 @@ | |||
595 | 53 | <li class="nav-item"><a class="active nav-link" href=".">Home</a></li> | 53 | <li class="nav-item"><a class="active nav-link" href=".">Home</a></li> |
596 | 54 | <li class="nav-item"><a class="nav-link" href="main.html">Main</a></li> | 54 | <li class="nav-item"><a class="nav-link" href="main.html">Main</a></li> |
597 | 55 | <li class="nav-item"><a class="nav-link" href="universe.html">Universe</a></li> | 55 | <li class="nav-item"><a class="nav-link" href="universe.html">Universe</a></li> |
598 | 56 | <li class="nav-item"><a class="nav-link" href="partner.html">Partner</a></li> | ||
599 | 57 | </ul> | 56 | </ul> |
600 | 58 | </div><!--/.nav-collapse --> | 57 | </div><!--/.nav-collapse --> |
601 | 59 | </nav> | 58 | </nav> |
602 | @@ -66,7 +65,6 @@ | |||
603 | 66 | 65 | ||
604 | 67 | <div> | 66 | <div> |
605 | 68 | <p />Open <a href="main.html">CVEs in Main</a> archive (and <a href="main-released.html">without devel release</a>) | 67 | <p />Open <a href="main.html">CVEs in Main</a> archive (and <a href="main-released.html">without devel release</a>) |
606 | 69 | <p />Open <a href="partner.html">CVEs in Partner</a> archive (and <a href="partner-released.html">without devel release</a>) | ||
607 | 70 | <p />Open <a href="universe.html">CVEs in Universe</a> archive (and <a href="universe-released.html">without devel release</a>) | 68 | <p />Open <a href="universe.html">CVEs in Universe</a> archive (and <a href="universe-released.html">without devel release</a>) |
608 | 71 | <p /> | 69 | <p /> |
609 | 72 | <p />Search for a specific CVE in Ubuntu (CVE-YYYY-NNNN): <form method="GET"><input name="cve" type="text" /></form> | 70 | <p />Search for a specific CVE in Ubuntu (CVE-YYYY-NNNN): <form method="GET"><input name="cve" type="text" /></form> |
610 | diff --git a/scripts/html/top/priority.html b/scripts/html/top/priority.html | |||
611 | index d339e9f..4fa80b7 100644 | |||
612 | --- a/scripts/html/top/priority.html | |||
613 | +++ b/scripts/html/top/priority.html | |||
614 | @@ -33,7 +33,6 @@ | |||
615 | 33 | <li class="nav-item"><a class="nav-link" href=".">Home</a></li> | 33 | <li class="nav-item"><a class="nav-link" href=".">Home</a></li> |
616 | 34 | <li class="nav-item"><a class="nav-link" href="main.html">Main</a></li> | 34 | <li class="nav-item"><a class="nav-link" href="main.html">Main</a></li> |
617 | 35 | <li class="nav-item"><a class="nav-link" href="universe.html">Universe</a></li> | 35 | <li class="nav-item"><a class="nav-link" href="universe.html">Universe</a></li> |
618 | 36 | <li class="nav-item"><a class="nav-link" href="partner.html">Partner</a></li> | ||
619 | 37 | </ul> | 36 | </ul> |
620 | 38 | </div><!--/.nav-collapse --> | 37 | </div><!--/.nav-collapse --> |
621 | 39 | </nav> | 38 | </nav> |
622 | diff --git a/scripts/html_export.py b/scripts/html_export.py | |||
623 | index c009a3a..1dc8e29 100755 | |||
624 | --- a/scripts/html_export.py | |||
625 | +++ b/scripts/html_export.py | |||
626 | @@ -67,7 +67,6 @@ def html_header(title, description, outfd): | |||
627 | 67 | <li class="nav-item"><a class="nav-link" href="..">Home</a></li> | 67 | <li class="nav-item"><a class="nav-link" href="..">Home</a></li> |
628 | 68 | <li class="nav-item"><a class="nav-link" href="../main.html">Main</a></li> | 68 | <li class="nav-item"><a class="nav-link" href="../main.html">Main</a></li> |
629 | 69 | <li class="nav-item"><a class="nav-link" href="../universe.html">Universe</a></li> | 69 | <li class="nav-item"><a class="nav-link" href="../universe.html">Universe</a></li> |
630 | 70 | <li class="nav-item"><a class="nav-link" href="../partner.html">Partner</a></li> | ||
631 | 71 | </ul> | 70 | </ul> |
632 | 72 | </div><!--/.nav-collapse --> | 71 | </div><!--/.nav-collapse --> |
633 | 73 | </nav> | 72 | </nav> |
634 | diff --git a/scripts/monthly-report b/scripts/monthly-report | |||
635 | index 37757d6..939d483 100755 | |||
636 | --- a/scripts/monthly-report | |||
637 | +++ b/scripts/monthly-report | |||
638 | @@ -19,9 +19,6 @@ | |||
639 | 19 | # For all the supported packages in Ubuntu, there are 67 medium-priority | 19 | # For all the supported packages in Ubuntu, there are 67 medium-priority |
640 | 20 | # issues and 206 low issues that need to be fixed in 142 packages. | 20 | # issues and 206 low issues that need to be fixed in 142 packages. |
641 | 21 | # | 21 | # |
642 | 22 | # For all partner packages in Ubuntu, there is 1 medium-priority issue | ||
643 | 23 | # that needs to be fixed in 1 package. | ||
644 | 24 | # | ||
645 | 25 | # For all community-supported packages in Ubuntu, there are 7 high-priority | 22 | # For all community-supported packages in Ubuntu, there are 7 high-priority |
646 | 26 | # issues, 721 medium-priority, and 1005 low-priority issues that need to be | 23 | # issues, 721 medium-priority, and 1005 low-priority issues that need to be |
647 | 27 | # fixed in 686 packages. | 24 | # fixed in 686 packages. |
648 | diff --git a/scripts/packages-mirror b/scripts/packages-mirror | |||
649 | index 71413a6..f053ff0 100755 | |||
650 | --- a/scripts/packages-mirror | |||
651 | +++ b/scripts/packages-mirror | |||
652 | @@ -26,7 +26,6 @@ Usage: packages_mirror [OPTIONS] | |||
653 | 26 | -V even more verbose output | 26 | -V even more verbose output |
654 | 27 | -r RELEASE only update Ubuntu release | 27 | -r RELEASE only update Ubuntu release |
655 | 28 | -A pull only release pocket for the devel release | 28 | -A pull only release pocket for the devel release |
656 | 29 | -p pull only partner | ||
657 | 30 | -u pull only ubuntu archive | 29 | -u pull only ubuntu archive |
658 | 31 | EOM | 30 | EOM |
659 | 32 | } | 31 | } |
660 | @@ -42,7 +41,6 @@ verbosity_args="-q" | |||
661 | 42 | only_release= | 41 | only_release= |
662 | 43 | devel_quick_pockets= | 42 | devel_quick_pockets= |
663 | 44 | very_verbose="" | 43 | very_verbose="" |
664 | 45 | only_partner="no" | ||
665 | 46 | only_ubuntu="no" | 44 | only_ubuntu="no" |
666 | 47 | 45 | ||
667 | 48 | while getopts "AwhftvVpur:" opt | 46 | while getopts "AwhftvVpur:" opt |
668 | @@ -56,7 +54,6 @@ do | |||
669 | 56 | very_verbose="yes";; | 54 | very_verbose="yes";; |
670 | 57 | A) devel_quick_pockets="yes";; | 55 | A) devel_quick_pockets="yes";; |
671 | 58 | r) only_release="$OPTARG";; | 56 | r) only_release="$OPTARG";; |
672 | 59 | p) only_partner="yes";; | ||
673 | 60 | u) only_ubuntu="yes";; | 57 | u) only_ubuntu="yes";; |
674 | 61 | h) help ; exit 0;; | 58 | h) help ; exit 0;; |
675 | 62 | ?) help;; | 59 | ?) help;; |
676 | @@ -73,7 +70,7 @@ debian=${debian:-ftp.debian.org} | |||
677 | 73 | # shellcheck disable=SC1091 | 70 | # shellcheck disable=SC1091 |
678 | 74 | . "$HOME"/.ubuntu-cve-tracker.conf | 71 | . "$HOME"/.ubuntu-cve-tracker.conf |
679 | 75 | 72 | ||
681 | 76 | for var in packages_mirror debian_mirror partner_mirror; do | 73 | for var in packages_mirror debian_mirror; do |
682 | 77 | if [ -z "${!var}" ]; then | 74 | if [ -z "${!var}" ]; then |
683 | 78 | echo "'$var' not defined in ~/.ubuntu-cve-tracker.conf" >&2 | 75 | echo "'$var' not defined in ~/.ubuntu-cve-tracker.conf" >&2 |
684 | 79 | exit 1 | 76 | exit 1 |
685 | @@ -87,23 +84,6 @@ mkdir -p "$outPath" | |||
686 | 87 | debianPath=$debian_mirror | 84 | debianPath=$debian_mirror |
687 | 88 | mkdir -p "$debianPath" | 85 | mkdir -p "$debianPath" |
688 | 89 | 86 | ||
689 | 90 | # shellcheck disable=SC2154 | ||
690 | 91 | partnerPath=$partner_mirror | ||
691 | 92 | mkdir -p "$partnerPath" | ||
692 | 93 | |||
693 | 94 | partner_dir_excludes=$(PYTHONPATH="${PYTHONPATH:+$PYTHONPATH:}$(dirname "$0")" python3 -c '# | ||
694 | 95 | import cve_lib, sys | ||
695 | 96 | s = "" | ||
696 | 97 | for r in cve_lib.eol_releases + ["breezy", "warty", "hoary"]: | ||
697 | 98 | if r in ["dapper", "breezy", "warty", "hoary"]: # http://archive.canonical.com/dists/ does not have these any more | ||
698 | 99 | continue | ||
699 | 100 | # Dont exclude ESM releases | ||
700 | 101 | if r in ["trusty", "xenial"]: | ||
701 | 102 | continue | ||
702 | 103 | s += "dists/%s*/," % r | ||
703 | 104 | sys.stdout.write(s.rstrip(",")) | ||
704 | 105 | ') | ||
705 | 106 | |||
706 | 107 | function compressed_ext() | 87 | function compressed_ext() |
707 | 108 | { | 88 | { |
708 | 109 | rel="$1" | 89 | rel="$1" |
709 | @@ -286,56 +266,54 @@ function do_use_timestamp() { | |||
710 | 286 | return 1 | 266 | return 1 |
711 | 287 | } | 267 | } |
712 | 288 | 268 | ||
719 | 289 | if [ "$only_partner" = "no" ]; then | 269 | timestamp="${outPath}.timestamp" |
720 | 290 | timestamp="${outPath}.timestamp" | 270 | if [ ! -e "${outPath}/dists" ] || do_use_timestamp "$timestamp" ; then |
721 | 291 | if [ ! -e "${outPath}/dists" ] || do_use_timestamp "$timestamp" ; then | 271 | pull=$(mktemp -t packages-XXXXXX) |
722 | 292 | pull=$(mktemp -t packages-XXXXXX) | 272 | # shellcheck disable=SC2064 |
723 | 293 | # shellcheck disable=SC2064 | 273 | trap "rm -f $pull" EXIT HUP INT QUIT TERM |
718 | 294 | trap "rm -f $pull" EXIT HUP INT QUIT TERM | ||
724 | 295 | 274 | ||
768 | 296 | # Sync Packages for non-ports supported arches | 275 | # Sync Packages for non-ports supported arches |
769 | 297 | if [ "$verbosity_args" != "-q" ]; then | 276 | if [ "$verbosity_args" != "-q" ]; then |
770 | 298 | echo "Generating arch lists" | 277 | echo "Generating arch lists" |
771 | 299 | fi | 278 | fi |
772 | 300 | # shellcheck disable=SC2129 | 279 | # shellcheck disable=SC2129 |
773 | 301 | gen_packages trusty "amd64 i386" >> "$pull" | 280 | gen_packages trusty "amd64 i386" >> "$pull" |
774 | 302 | gen_packages xenial "amd64 i386" >> "$pull" | 281 | gen_packages xenial "amd64 i386" >> "$pull" |
775 | 303 | gen_packages bionic "amd64 i386" >> "$pull" | 282 | gen_packages bionic "amd64 i386" >> "$pull" |
776 | 304 | gen_packages focal "amd64 i386" >> "$pull" | 283 | gen_packages focal "amd64 i386" >> "$pull" |
777 | 305 | gen_packages jammy "amd64 i386" >> "$pull" | 284 | gen_packages jammy "amd64 i386" >> "$pull" |
778 | 306 | gen_packages kinetic "amd64 i386" >> "$pull" | 285 | gen_packages kinetic "amd64 i386" >> "$pull" |
779 | 307 | gen_packages lunar "amd64 i386" >> "$pull" | 286 | gen_packages lunar "amd64 i386" >> "$pull" |
780 | 308 | gen_packages mantic "amd64 i386" >> "$pull" | 287 | gen_packages mantic "amd64 i386" >> "$pull" |
781 | 309 | 288 | ||
782 | 310 | # don't bother to pull duplicates | 289 | # don't bother to pull duplicates |
783 | 311 | sort -u "$pull" > "$pull.sorted" && mv "$pull.sorted" "$pull"; rm -f "$pull.sorted" | 290 | sort -u "$pull" > "$pull.sorted" && mv "$pull.sorted" "$pull"; rm -f "$pull.sorted" |
784 | 312 | pull_packages "$pull" "$server/ubuntu" || echo "FAIL: supported architectures" >&2 | 291 | pull_packages "$pull" "$server/ubuntu" || echo "FAIL: supported architectures" >&2 |
785 | 313 | cat /dev/null > "$pull" | 292 | cat /dev/null > "$pull" |
786 | 314 | 293 | ||
787 | 315 | # Sync Packages for ports arches | 294 | # Sync Packages for ports arches |
788 | 316 | if [ "$verbosity_args" != "-q" ]; then | 295 | if [ "$verbosity_args" != "-q" ]; then |
789 | 317 | echo "Generating ports arch lists" | 296 | echo "Generating ports arch lists" |
790 | 318 | fi | 297 | fi |
791 | 319 | # shellcheck disable=SC2129 | 298 | # shellcheck disable=SC2129 |
792 | 320 | gen_packages trusty "powerpc ppc64el armhf arm64" >> "$pull" | 299 | gen_packages trusty "powerpc ppc64el armhf arm64" >> "$pull" |
793 | 321 | gen_packages xenial "powerpc ppc64el armhf arm64 s390x" >> "$pull" | 300 | gen_packages xenial "powerpc ppc64el armhf arm64 s390x" >> "$pull" |
794 | 322 | gen_packages bionic "ppc64el armhf arm64 s390x" >> "$pull" | 301 | gen_packages bionic "ppc64el armhf arm64 s390x" >> "$pull" |
795 | 323 | gen_packages focal "ppc64el armhf arm64 s390x riscv64" >> "$pull" | 302 | gen_packages focal "ppc64el armhf arm64 s390x riscv64" >> "$pull" |
796 | 324 | gen_packages jammy "ppc64el armhf arm64 s390x riscv64" >> "$pull" | 303 | gen_packages jammy "ppc64el armhf arm64 s390x riscv64" >> "$pull" |
797 | 325 | gen_packages kinetic "ppc64el armhf arm64 s390x riscv64" >> "$pull" | 304 | gen_packages kinetic "ppc64el armhf arm64 s390x riscv64" >> "$pull" |
798 | 326 | gen_packages lunar "ppc64el armhf arm64 s390x riscv64" >> "$pull" | 305 | gen_packages lunar "ppc64el armhf arm64 s390x riscv64" >> "$pull" |
799 | 327 | gen_packages mantic "ppc64el armhf arm64 s390x riscv64" >> "$pull" | 306 | gen_packages mantic "ppc64el armhf arm64 s390x riscv64" >> "$pull" |
800 | 328 | 307 | ||
801 | 329 | # don't bother to pull duplicates | 308 | # don't bother to pull duplicates |
802 | 330 | sort -u "$pull" > "$pull.sorted" && mv "$pull.sorted" "$pull"; rm -f "$pull.sorted" | 309 | sort -u "$pull" > "$pull.sorted" && mv "$pull.sorted" "$pull"; rm -f "$pull.sorted" |
803 | 331 | pull_packages "$pull" "$ports/ubuntu-ports" || echo "FAIL: ports architectures" >&2 | 310 | pull_packages "$pull" "$ports/ubuntu-ports" || echo "FAIL: ports architectures" >&2 |
804 | 332 | cat /dev/null > "$pull" | 311 | cat /dev/null > "$pull" |
805 | 333 | 312 | ||
806 | 334 | if [ "$use_timestamp" = "yes" ]; then | 313 | if [ "$use_timestamp" = "yes" ]; then |
807 | 335 | touch "$timestamp" | 314 | touch "$timestamp" |
808 | 336 | else | 315 | else |
809 | 337 | rm -f "$timestamp" | 316 | rm -f "$timestamp" |
767 | 338 | fi | ||
810 | 339 | fi | 317 | fi |
811 | 340 | fi | 318 | fi |
812 | 341 | 319 | ||
813 | @@ -348,7 +326,7 @@ if [ "$only_ubuntu" = "no" ]; then | |||
814 | 348 | fi | 326 | fi |
815 | 349 | 327 | ||
816 | 350 | # TODO: add Debian support for -r | 328 | # TODO: add Debian support for -r |
818 | 351 | if [ -z "$only_release" ] && [ "$only_partner" = "no" ]; then | 329 | if [ -z "$only_release" ]; then |
819 | 352 | # Sync Sources from Debian testing | 330 | # Sync Sources from Debian testing |
820 | 353 | timestamp="${debianPath}.timestamp" | 331 | timestamp="${debianPath}.timestamp" |
821 | 354 | if [ ! -e "${debianPath}/dists" ] || do_use_timestamp "$timestamp" 6 ; then | 332 | if [ ! -e "${debianPath}/dists" ] || do_use_timestamp "$timestamp" 6 ; then |
822 | @@ -368,37 +346,9 @@ if [ "$only_ubuntu" = "no" ]; then | |||
823 | 368 | fi | 346 | fi |
824 | 369 | fi | 347 | fi |
825 | 370 | fi | 348 | fi |
826 | 371 | |||
827 | 372 | if [ -z "$only_release" ] || [ "$only_partner" = "yes" ]; then | ||
828 | 373 | # Sync Canonical Partner Repo | ||
829 | 374 | timestamp="${partnerPath}.timestamp" | ||
830 | 375 | if [ ! -e "${partnerPath}/dists" ] || do_use_timestamp "$timestamp" 6 ; then | ||
831 | 376 | cd "$partnerPath" | ||
832 | 377 | misc_partner_excludes="robots.txt,misc/,project/,icons/,ls-lR.gz" | ||
833 | 378 | wget $verbosity_args -N -R '*=*' -R 'Contents*' -X "${misc_partner_excludes},${partner_dir_excludes}" -np -r http://archive.canonical.com/dists/ | ||
834 | 379 | |||
835 | 380 | ln -sf archive.canonical.com/dists dists | ||
836 | 381 | # remove dangling symlink | ||
837 | 382 | rm -f archive.canonical.com/dists/dists || true | ||
838 | 383 | |||
839 | 384 | # remove dists.[0-9] files | ||
840 | 385 | rm -f archive.canonical.com/dists.[0-9]* | ||
841 | 386 | |||
842 | 387 | if [ "$use_timestamp" = "yes" ]; then | ||
843 | 388 | touch "$timestamp" | ||
844 | 389 | else | ||
845 | 390 | rm -f "$timestamp" | ||
846 | 391 | fi | ||
847 | 392 | has_sources=$(find archive.canonical.com/dists -name Sources$) | ||
848 | 393 | if [ -n "$has_sources" ]; then | ||
849 | 394 | echo "" | ||
850 | 395 | echo "WARNING: $partnerPath has Sources files! These should be removed now that -partner uses Sources.gz" | ||
851 | 396 | fi | ||
852 | 397 | fi | ||
853 | 398 | fi | ||
854 | 399 | fi | 349 | fi |
855 | 400 | 350 | ||
856 | 401 | # generate source package lists for umt grep | 351 | # generate source package lists for umt grep |
858 | 402 | for path in "$outPath" "$debianPath" "$partnerPath"; do | 352 | for path in "$outPath" "$debianPath"; do |
859 | 403 | find "$path" -name Sources.gz -exec zgrep '^Package: .*' {} \; | cut -c10- | sort -u > "$path/sources" | 353 | find "$path" -name Sources.gz -exec zgrep '^Package: .*' {} \; | cut -c10- | sort -u > "$path/sources" |
860 | 404 | done | 354 | done |
861 | diff --git a/scripts/report-todo-numbers b/scripts/report-todo-numbers | |||
862 | index 32b7d1f..502b5b1 100755 | |||
863 | --- a/scripts/report-todo-numbers | |||
864 | +++ b/scripts/report-todo-numbers | |||
865 | @@ -45,7 +45,7 @@ only_packages = [] | |||
866 | 45 | if opt.only_packages: | 45 | if opt.only_packages: |
867 | 46 | only_packages = re.split(',', opt.only_packages) | 46 | only_packages = re.split(',', opt.only_packages) |
868 | 47 | 47 | ||
870 | 48 | for category in ['supported','partner','universe']: | 48 | for category in ['supported','universe']: |
871 | 49 | item[category] = dict() | 49 | item[category] = dict() |
872 | 50 | srcpkg_item[category] = dict() | 50 | srcpkg_item[category] = dict() |
873 | 51 | 51 | ||
874 | @@ -63,9 +63,6 @@ for category in ['supported','partner','universe']: | |||
875 | 63 | if 'SUPPORTED' in line: | 63 | if 'SUPPORTED' in line: |
876 | 64 | if category != 'supported': | 64 | if category != 'supported': |
877 | 65 | continue | 65 | continue |
878 | 66 | elif 'PARTNER' in line: | ||
879 | 67 | if category != 'partner': | ||
880 | 68 | continue | ||
881 | 69 | elif category != 'universe': | 66 | elif category != 'universe': |
882 | 70 | continue | 67 | continue |
883 | 71 | 68 | ||
884 | @@ -131,8 +128,6 @@ for category in ['supported','partner','universe']: | |||
885 | 131 | else: | 128 | else: |
886 | 132 | if category == 'supported': | 129 | if category == 'supported': |
887 | 133 | print " * For all the supported packages in Ubuntu, there", | 130 | print " * For all the supported packages in Ubuntu, there", |
888 | 134 | elif category == 'partner': | ||
889 | 135 | print " * For all partner packages in Ubuntu, there", | ||
890 | 136 | elif category == 'universe': | 131 | elif category == 'universe': |
891 | 137 | print " * For all community-supported packages in Ubuntu, there", | 132 | print " * For all community-supported packages in Ubuntu, there", |
892 | 138 | if opt.show_unique_sources: | 133 | if opt.show_unique_sources: |
893 | diff --git a/scripts/report-todo-plot b/scripts/report-todo-plot | |||
894 | index e5faa4a..d59014f 100755 | |||
895 | --- a/scripts/report-todo-plot | |||
896 | +++ b/scripts/report-todo-plot | |||
897 | @@ -13,7 +13,7 @@ TABLE=$(./scripts/ubuntu-table -s "$@") | |||
898 | 13 | for category in ${CATEGORY:-SUPPORTED} | 13 | for category in ${CATEGORY:-SUPPORTED} |
899 | 14 | do | 14 | do |
900 | 15 | if [ "x$category" = "xuniverse" ]; then | 15 | if [ "x$category" = "xuniverse" ]; then |
902 | 16 | filter="-v '(SUPPORTED|PARTNER)'" | 16 | filter="-v 'SUPPORTED'" |
903 | 17 | else | 17 | else |
904 | 18 | filter=$category | 18 | filter=$category |
905 | 19 | fi | 19 | fi |
906 | diff --git a/scripts/source_map.py b/scripts/source_map.py | |||
907 | index 4ff605e..05e258b 100755 | |||
908 | --- a/scripts/source_map.py | |||
909 | +++ b/scripts/source_map.py | |||
910 | @@ -48,10 +48,9 @@ def read_config_file(config_file): | |||
911 | 48 | 48 | ||
912 | 49 | def _find_sources(pockets=None, releases=None, skip_eol_releases=True, arch='amd64'): | 49 | def _find_sources(pockets=None, releases=None, skip_eol_releases=True, arch='amd64'): |
913 | 50 | config = read_config_file(os.path.expanduser("~/.ubuntu-cve-tracker.conf")) | 50 | config = read_config_file(os.path.expanduser("~/.ubuntu-cve-tracker.conf")) |
915 | 51 | if 'packages_mirror' in config and 'partner_mirror' in config: | 51 | if 'packages_mirror' in config: |
916 | 52 | cve_lib.check_mirror_timestamp(config) | 52 | cve_lib.check_mirror_timestamp(config) |
917 | 53 | return _find_from_mirror(config['packages_mirror'], | 53 | return _find_from_mirror(config['packages_mirror'], |
918 | 54 | config['partner_mirror'], | ||
919 | 55 | 'sources', | 54 | 'sources', |
920 | 56 | pockets=pockets, | 55 | pockets=pockets, |
921 | 57 | releases=releases, | 56 | releases=releases, |
922 | @@ -63,10 +62,9 @@ def _find_sources(pockets=None, releases=None, skip_eol_releases=True, arch='amd | |||
923 | 63 | 62 | ||
924 | 64 | def _find_packages(pockets=None, releases=None, skip_eol_releases=True, arch='amd64'): | 63 | def _find_packages(pockets=None, releases=None, skip_eol_releases=True, arch='amd64'): |
925 | 65 | config = read_config_file(os.path.expanduser("~/.ubuntu-cve-tracker.conf")) | 64 | config = read_config_file(os.path.expanduser("~/.ubuntu-cve-tracker.conf")) |
927 | 66 | if 'packages_mirror' in config and 'partner_mirror' in config: | 65 | if 'packages_mirror' in config: |
928 | 67 | cve_lib.check_mirror_timestamp(config) | 66 | cve_lib.check_mirror_timestamp(config) |
929 | 68 | return _find_from_mirror(config['packages_mirror'], | 67 | return _find_from_mirror(config['packages_mirror'], |
930 | 69 | config['partner_mirror'], | ||
931 | 70 | 'packages', | 68 | 'packages', |
932 | 71 | pockets=pockets, | 69 | pockets=pockets, |
933 | 72 | releases=releases, | 70 | releases=releases, |
934 | @@ -102,7 +100,7 @@ def load_debian(basedir, data_type='sources'): | |||
935 | 102 | return debian_sources | 100 | return debian_sources |
936 | 103 | 101 | ||
937 | 104 | 102 | ||
939 | 105 | def _find_from_mirror(ubuntu, canonical, data_type, arch='amd64', pockets=None, releases=None, skip_eol_releases=True): | 103 | def _find_from_mirror(ubuntu, data_type, arch='amd64', pockets=None, releases=None, skip_eol_releases=True): |
940 | 106 | if data_type not in ['sources', 'packages']: | 104 | if data_type not in ['sources', 'packages']: |
941 | 107 | raise ValueError("'data_type' should be either 'sources' or 'packages'") | 105 | raise ValueError("'data_type' should be either 'sources' or 'packages'") |
942 | 108 | 106 | ||
943 | @@ -138,9 +136,6 @@ def _find_from_mirror(ubuntu, canonical, data_type, arch='amd64', pockets=None, | |||
944 | 138 | # free | 136 | # free |
945 | 139 | for pocket in pockets: | 137 | for pocket in pockets: |
946 | 140 | for section in sections: | 138 | for section in sections: |
947 | 141 | if section == 'partner': | ||
948 | 142 | # handled separately below | ||
949 | 143 | continue | ||
950 | 144 | if data_type == 'sources': | 139 | if data_type == 'sources': |
951 | 145 | fn = os.path.join(ubuntu, 'dists', series + pocket, section, | 140 | fn = os.path.join(ubuntu, 'dists', series + pocket, section, |
952 | 146 | 'source', 'Sources') | 141 | 'source', 'Sources') |
953 | @@ -162,40 +157,6 @@ def _find_from_mirror(ubuntu, canonical, data_type, arch='amd64', pockets=None, | |||
954 | 162 | name = '' | 157 | name = '' |
955 | 163 | 158 | ||
956 | 164 | collection += [(fn, rel, name, section)] | 159 | collection += [(fn, rel, name, section)] |
957 | 165 | # partner | ||
958 | 166 | pocket = '' | ||
959 | 167 | section = 'partner' | ||
960 | 168 | |||
961 | 169 | if data_type == 'sources': | ||
962 | 170 | fn = os.path.join(canonical, 'dists', series + pocket, section, | ||
963 | 171 | 'source', 'Sources') | ||
964 | 172 | else: | ||
965 | 173 | fn = os.path.join(canonical, 'dists', series + pocket, section, | ||
966 | 174 | 'binary-%s' % arch, 'Packages') | ||
967 | 175 | |||
968 | 176 | found, fn_path = _find_path_with_ext(fn) | ||
969 | 177 | if not found: | ||
970 | 178 | # Only warn about missing partner for devel release | ||
971 | 179 | # FIXME: 2020-04-29: disabled partner warning for dev for now | ||
972 | 180 | # FIXME: 2021-04-24: disabling for both devel and hirsute; | ||
973 | 181 | # looks like mirroring on people.c.c stopped? | ||
974 | 182 | if rel == cve_lib.devel_release or rel in ['hirsute', 'impish', 'jammy', 'kinetic', 'lunar']: | ||
975 | 183 | prefreeze = os.path.join(canonical, 'dists', '%s-series' % rel[0]) | ||
976 | 184 | prefreeze | ||
977 | 185 | #if not os.path.isdir(prefreeze): | ||
978 | 186 | # print(sys.stderr, "WARNING: missing partner mirror element: %s" % (fn), file=sys.stderr) | ||
979 | 187 | # else: | ||
980 | 188 | # print("WARNING: found prefreeze element: %s" % (prefreeze), file=sys.stderr) | ||
981 | 189 | else: | ||
982 | 190 | missing += " %s\n" % (fn) | ||
983 | 191 | errors = True | ||
984 | 192 | continue | ||
985 | 193 | else: | ||
986 | 194 | fn = fn_path | ||
987 | 195 | |||
988 | 196 | if section not in sections: | ||
989 | 197 | continue | ||
990 | 198 | collection += [(fn, rel, pocket, section)] | ||
991 | 199 | 160 | ||
992 | 200 | if errors: | 161 | if errors: |
993 | 201 | raise NameError("Missing mirror elements:\n" + missing) | 162 | raise NameError("Missing mirror elements:\n" + missing) |
994 | @@ -244,12 +205,6 @@ def _find_sources_from_apt(pockets=None, releases=None): | |||
995 | 244 | not (rel == cve_lib.devel_release and pocket in ['-updates', '-security']): | 205 | not (rel == cve_lib.devel_release and pocket in ['-updates', '-security']): |
996 | 245 | missing += " deb-src http://archive.ubuntu.com/ubuntu %s%s %s\n" % (rel, pocket, ' '.join(cve_lib.components)) | 206 | missing += " deb-src http://archive.ubuntu.com/ubuntu %s%s %s\n" % (rel, pocket, ' '.join(cve_lib.components)) |
997 | 246 | errors = True | 207 | errors = True |
998 | 247 | for component in ['partner']: | ||
999 | 248 | # partner doesn't get the devel release treatment until late in | ||
1000 | 249 | # the cycle | ||
1001 | 250 | if '%s_%s' % (rel, component) not in saw and not (rel == cve_lib.devel_release) and not cve_lib.release_has_partner(rel): | ||
1002 | 251 | missing += " deb-src http://archive.canonical.com/ubuntu %s %s\n" % (rel, component) | ||
1003 | 252 | errors = True | ||
1004 | 253 | if errors: | 208 | if errors: |
1005 | 254 | raise NameError("Missing /etc/apt/sources.list lines:\n%s" % (missing)) | 209 | raise NameError("Missing /etc/apt/sources.list lines:\n%s" % (missing)) |
1006 | 255 | 210 | ||
1007 | diff --git a/scripts/ubuntu-table b/scripts/ubuntu-table | |||
1008 | index eeb633c..b1651c0 100755 | |||
1009 | --- a/scripts/ubuntu-table | |||
1010 | +++ b/scripts/ubuntu-table | |||
1011 | @@ -232,7 +232,6 @@ for cve in sorted(cves): | |||
1012 | 232 | action_needed = False # A package in any release needs updating | 232 | action_needed = False # A package in any release needs updating |
1013 | 233 | released = False # A package in any release has been fixed | 233 | released = False # A package in any release has been fixed |
1014 | 234 | supported = False # A package in any release is supported and needs to be fixed | 234 | supported = False # A package in any release is supported and needs to be fixed |
1015 | 235 | partner = False # A package in any release is partner-supplied | ||
1016 | 236 | universe = False # A package in any release is in universe and needs to be fixed | 235 | universe = False # A package in any release is in universe and needs to be fixed |
1017 | 237 | 236 | ||
1018 | 238 | mark = dict() | 237 | mark = dict() |
1019 | @@ -272,10 +271,6 @@ for cve in sorted(cves): | |||
1020 | 272 | if pkg_rel_supported: | 271 | if pkg_rel_supported: |
1021 | 273 | supported = True | 272 | supported = True |
1022 | 274 | 273 | ||
1023 | 275 | # A partner issue? | ||
1024 | 276 | if cve_lib.is_partner(map, pkg, rel): | ||
1025 | 277 | partner = True | ||
1026 | 278 | |||
1027 | 279 | if opt.debug: | 274 | if opt.debug: |
1028 | 280 | print("%s: %s: %s (%s, released:%d)" % (cve, pkg, table[cve][pkg][rel], rel, released), file=sys.stderr) | 275 | print("%s: %s: %s (%s, released:%d)" % (cve, pkg, table[cve][pkg][rel], rel, released), file=sys.stderr) |
1029 | 281 | 276 | ||
1030 | @@ -317,9 +312,7 @@ for cve in sorted(cves): | |||
1031 | 317 | print('<td style="font-size: small;"><a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=%s">Mitre</a> <a href="https://launchpad.net/bugs/cve/%s">LP</a> <a href="http://security-tracker.debian.org/tracker/%s">Debian</a></td>' % (quote(cve), quote(cve), quote(cve)), end=' ') | 312 | print('<td style="font-size: small;"><a href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=%s">Mitre</a> <a href="https://launchpad.net/bugs/cve/%s">LP</a> <a href="http://security-tracker.debian.org/tracker/%s">Debian</a></td>' % (quote(cve), quote(cve), quote(cve)), end=' ') |
1032 | 318 | print('<td>', end=' ') | 313 | print('<td>', end=' ') |
1033 | 319 | if opt.supported: | 314 | if opt.supported: |
1037 | 320 | if partner: | 315 | if supported: |
1035 | 321 | print('<p>PARTNER</p>', end=' ') | ||
1036 | 322 | elif supported: | ||
1038 | 323 | print('<p>SUPPORTED</p>', end=' ') | 316 | print('<p>SUPPORTED</p>', end=' ') |
1039 | 324 | if universe: | 317 | if universe: |
1040 | 325 | print('<p>UNIVERSE</p>', end=' ') | 318 | print('<p>UNIVERSE</p>', end=' ') |
1041 | @@ -348,9 +341,7 @@ for cve in sorted(cves): | |||
1042 | 348 | if action_needed and released: | 341 | if action_needed and released: |
1043 | 349 | print('[out of sync]', end=' ') | 342 | print('[out of sync]', end=' ') |
1044 | 350 | if opt.supported: | 343 | if opt.supported: |
1048 | 351 | if partner: | 344 | if supported: |
1046 | 352 | print('PARTNER', end=' ') | ||
1047 | 353 | elif supported: | ||
1049 | 354 | print('SUPPORTED', end=' ') | 345 | print('SUPPORTED', end=' ') |
1050 | 355 | if universe: | 346 | if universe: |
1051 | 356 | print('UNIVERSE', end=' ') | 347 | print('UNIVERSE', end=' ') |
The only thing that sticks out is this:
+ global esm_warned
The rest LGTM. Thanks!