~laney/autopkgtest-cloud:browse-esm

Last commit made on 2021-05-07
Get this branch:
git clone -b browse-esm https://git.launchpad.net/~laney/autopkgtest-cloud
Only Iain Lane can upload to this branch. If you are Iain Lane please log in for upload directions.

Branch merges

Branch information

Name:
browse-esm
Repository:
lp:~laney/autopkgtest-cloud

Recent commits

f4e2298... by Iain Lane

web: Add esm to /packages/ pages

It's still useful for people to be able to retrieve these results.
They're already downloaded into the DB.

14e6c9a... by Iain Lane

service-bundle: Add 12 more bos01/arm64 workers

We recently got increased capacity here, let's make use of it especially
now while we have a massive queue.

58dc0c2... by Iain Lane

web: More decoupling

We don't need to run download-results after download-all-results,
either.

654e806... by Iain Lane

web: Drop ordering of download-all-results wrt. download-results

They can run simultaneously, and this way we can keep receiving
real-time results while running download-all-results to catch up.

b107f8f... by Julian Andres Klode

web: Use WAL journaling for the r/w database

This means readers (publish-db) won't block writers anymore, the
download-results currently times out sometimes due to the lock
being held by publish-db.

8699044... by Julian Andres Klode

publish-db: Use the sqlite3 backup API to copy the DB

This seems to be 100% slower, but it should be safer to do as
we don't just copy the file object without any locks, which
might yield an inconsistent state.

We copy the file in steps of 128 * 1024 pages, this allows the lock
to be released in between, such that other programs can write
to it. Currently, that is about 3 iterations.

7ce1e87... by Iain Lane

web: storage-url-internal is not needed any more

4435efa... by Iain Lane

web, service-bundle: Proxy the results at the haproxy layer

There's really no need for this to have to hit the backends.

5b08bdb... by Julian Andres Klode

webcontrol: Create index on result(run_id desc)

This significantly improves performance on the query on the / page,
on my laptop from 0.7s to 0.001s.

Thanks: Dave Jones for the idea

949faf1... by Iain Lane

service-bundle: Bump haproxy more

Cutting it close. Dear me, this page needs optimising.