master : lp:usd-importer : Git : Code : usd-importer

Get this branch:: git clone -b master https://git.launchpad.net/usd-importer

Members of Ubuntu Server Dev import team can upload to this branch. Log in for directions.

Branch merges

25 branches proposed for merging into this one.

Branch information

Name:: master

Repository:: lp:usd-importer

Recent commits

cf563c6... by Andreas Hasenack on 2019-05-08

Add more pmdk related packages to the whitelist

Merged branch ~ahasenack/usd-importer:more-pmdk-related-packages-to-import

a7ac2f2... by Robie Basak on 2019-04-25

Blacklist wheezy as an active series

Merged branch ~racb/usd-importer:blacklist-wheezy

77f0186... by Robie Basak on 2019-04-23

Cache some Launchpad object fetches

As we iterate through Launchpad's source_package_publication_history
records, we keep looking up their distro_series objects via
GitUbuntuSourcePackageInformation.distribution.name and suchlike. This
results in a very large number of API calls to fetch the same
distro_series object from Launchpad every time, causing a severe
degradation in performance.

Since distribution_link is the same every time, we can instead key a
cache on this, eliminating the excessive number of API calls. The same
applies to some other similar calls.

As far as I can tell we've always made this excessive number of calls
here, but in practice something recently changed in the amount of time
these calls are taking, causing import performance to drop virtually to
a standstill. This optimisation restores reasonable performance again.

This introduces a new dependency on cachetools, which seems to be the
cleanest caching solution without having to reimplement it inside
git-ubuntu. python3-cachetools is available in Xenial and the module
seems to be stable upstream, so I hope this addition will not cause us
too much trouble.

Merged branch ~racb/usd-importer:optimise-api-calls

f372e77... by Karl Stenerud on 2019-03-28

Author: Karl Stenerud <email address hidden>
Date: Thu Mar 29 10:09:05 2019 +0100

Changed --deconstruct to --split

    "deconstruct" was being confused as the opposite of "reconstruct",
    even though they are different things. "split" makes for an
    easier to remember mnemonic.

Merged branch ~kstenerud/usd-importer:deconstruct-to-split

60fc847... by Claudio Matsuoka on 2019-02-27