Merge ~sbaldassin/bileto:ust-bileto into bileto:master

[Santiago Baldassin]

Adding ubuntu system tests to bileto

This change adds ubuntu system tests to bileto.

In order to deploy this, you'll need the qakit module available in the canonical-platform-qa ppa

[Robert Bruce Park (robru)]

Thanks for rebasing your works Santiago, apologies again for the git history situation. Some comments inline.

Before you fix any of the issues I raise in my review, though, we need to consider that Steve and Martin both want this triggered from Britney, so that it can work again during proposed-migration.

Also, during the meeting, we agreed that we would transition this in slowly, such that at first we just trigger the tests without reporting them anywhere, so that results can be manually inspected. Today I'll be digging into the britney code to figure out the best way to trigger this.

review: Needs Information

[Robert Bruce Park (robru)]

Also, where is the code for qakit.ust.worker?

Thanks

[Santiago Baldassin (sbaldassin)]

Thanks for your feedback Robert. I'll be working on your comments. In the meantime, here's the code for qakit: https://code.launchpad.net/qakit.

About triggering this from Britney during proposed migration, we would just need to re-use the code that I've added in bileto or we could just publish an amqp message (containing the ppa) to /ubuntu-system-tests. What we have to consider is that we want to avoid a message to be publish for every single package in ppa. From what I understood when I took a look at britney, a different amqp message is published for every single source package in the ppa and we need a single message for the whole ppa. The current worker is already listening amqp so I can give you a hand to test this if you want

Last but not least, I'd like to keep the reporting in bileto if you don't mind since it will help us to trace the results easily to our jenkins builds. Polling for results will generate a single http request which response is a 100 bytes message so the performance degradation in bileto should be minimum and I also make sure that if no response is received then an empty response is returned so that angularjs can parse it in any case

[Robert Bruce Park (robru)]

Ok, so I've had a chance to review the qakit source and I need to raise some concerns here. One thing is that the compute_ust_signoff as you've written it will be triggered every time the ticket is modified, for any reason. So it's true that the status job will update the ticket every 20 minutes, which will result in ust polling every 20 minutes, but it will also do a ust poll, eg, if a user edits a field on the ticket, and this is a really unacceptable slowdown for user experience, to do a syncronous poll and block the thread while the user is waiting for their change to save.

**IF** we go ahead with the idea of bileto polling ust results, we'll need to model it after britney/iterate.py, eg, there should be an independent script that runs from cron and then feeds the results into bileto. That way it would run much more consistently and performantly, without interfering with user edits of tickets.

[Santiago Baldassin (sbaldassin)]

Good point Robert! There's no need to poll for results when the user is editing the form. Instead of using an independent script to get the results, I'd like to suggest doing it with an ajax call in the app.js which will be triggered every 2 minutes. That way users will have to wait only 2 minutes in the worst case scenario and we'll be using a non blocking asynchronous method. As long as we update the scope in the callback, angular will take care of reflecting that in the ui

[Robert Bruce Park (robru)]

Well the problem with doing it in app.js is that it then runs client side:
if two people are viewing the same ticket you'll get redundant polling of
results, and if nobody is viewing the ticket then the results never appear!
if app.js then attempts to save the result to the ticket, the audit log
will appear as if users are entering information manually, eg, the log
would show "sbalda: ust_signoff: approved" which would be quite strange. Is
this really the behavior you want?

I think really the only sensible approach is to model britney/iterate.py:
run it from cron periodically, query bileto for what tickets to submit for
testing, get results and save them to the ticket. Except for the first
phase we just want to submit requests and not poll or display results just
yet.

On Sep 21, 2016 6:59 AM, "Santiago Baldassin" <
<email address hidden>> wrote:

> Good point Robert! There's no need to poll for results when the user is
> editing the form. Instead of using an independent script to get the
> results, I'd like to suggest doing it with an ajax call in the app.js which
> will be triggered every 2 minutes. That way users will have to wait only 2
> minutes in the worst case scenario and we'll be using a non blocking
> asynchronous method. As long as we update the scope in the callback,
> angular will take care of reflecting that in the ui
> --
> https://code.launchpad.net/~sbaldassin/bileto/+git/bileto/+merge/306251
> You are reviewing the proposed merge of ~sbaldassin/bileto:ust-bileto into
> bileto:master.
>

[Robert Bruce Park (robru)]

Sorry, another question: Are you saying it's possible to trigger UST with an ajax request? Or is the ajax request only for querying the status after it's been triggered?

If the former, I'd strongly prefer that over importing this qakit module, which imports jenkins module. Even when we used jenkins extensively, bileto only ever spoke JSON to it, I never had to import jenkins module, so I'd prefer not to start using that now if it can be helped.

[Santiago Baldassin (sbaldassin)]

Thanks Robert. I've addressed all your comments and replied to a couple of them inline. I've remove the polling results part for now and I'll be submitting a new mp for that

[Santiago Baldassin (sbaldassin)]

> Sorry, another question: Are you saying it's possible to trigger UST with an
> ajax request? Or is the ajax request only for querying the status after it's
> been triggered?
>
> If the former, I'd strongly prefer that over importing this qakit module,
> which imports jenkins module. Even when we used jenkins extensively, bileto
> only ever spoke JSON to it, I never had to import jenkins module, so I'd
> prefer not to start using that now if it can be helped.

I was thinking about an ajax request to get the results. About importing qakit, I'd like to keep it if you guys don't mind. Please take into account that qakit is not only talking to Jenkins but also to practitest and to launchpad. The beauty of using the jenkins lib is that you forget about dealing with http requests, catching errors, packing/unpacking requests and results, etc. By the way, the jenkins module is a well known and widely use module, so I'm not sure why we should not use it, that said, If there's any technical roadblock related to it, I'm open to change it

[Robert Bruce Park (robru)]

Hey Santiago, apologies I've been meaning to dedicate more time to this but the bileto.ubuntu.com rollout was not particularly smooth so I've had a few fires to put out.

The single greatest challenge we will face is the fact that britney runs in precise, which limits us to python 3.2, which is really showing its age. It's not clear to me that qakit or jenkins modules are going to work in precise, and backporting them may well be harder than just writing a few http requests.

In terms of the bileto side, I like to keep things as simple as possible, so loading the big jenkins module in my server process is really unappealing to me (even if you resolve the issue of polling jenkins every time a user edits a ticket, I won't accept any code that imports jenkins in bileto/*.py) keep in mind that our flask server has 15 worker processes so anything imported in bileto/*.py is going to be imported in 15 different processes and stick around forever.

The significantly better approach is to just have one script called periodically from cron. It can load jenkins, iterate over tickets, submit some tests, and then exit without being a huge burden on the system for a prolonged period of time.

[Santiago Baldassin (sbaldassin)]

Hi Robert, no need to apologize. I'll be working on getting rid of Jenkins in qakit and let you know when it's ready.

0c5bc46... by Santiago Baldassin on 2016-09-27

Moving the trigger for ust to iterate.py

3560ed2... by Santiago Baldassin on 2016-09-28

Merge branch 'master' of git+ssh://git.launchpad.net/bileto

Unmerged commits

0c5bc46... by Santiago Baldassin on 2016-09-27

Moving the trigger for ust to iterate.py

cbf2617... by Santiago Baldassin on 2016-09-16

Adding ubuntu system tests signoff

This includes an additional signoff for the requests in bileto.
Once a silo is assigned to the requests and the lander approved
the changes, ubuntu system tests will be triggered

3560ed2... by Santiago Baldassin on 2016-09-28

Merge branch 'master' of git+ssh://git.launchpad.net/bileto

5f56daa... by Santiago Baldassin on 2016-09-20

Merge branch 'master' of https://git.launchpad.net/bileto

3f02943... by Robert Bruce Park on 2016-09-05

Retry git fetch a few times before giving up.

83f2a02... by Robert Bruce Park on 2016-09-04

PPAs are no longer Assigned, they are Active.

e1975b4... by Robert Bruce Park on 2016-09-02

Add multiverse dependency as per cjwatson.

51950d6... by Robert Bruce Park on 2016-09-02

Create dir before copying into it.

7096cc8... by Robert Bruce Park on 2016-09-02

Increase authorized_size.

0ba81f4... by Robert Bruce Park on 2016-09-02

Ephemeral PPAs phase two: Use them for new tickets.

diff --git a/.bzr-builddeb/default.conf b/.bzr-builddeb/default.conf
new file mode 100644
index 0000000..6c96a98
--- /dev/null
+++ b/.bzr-builddeb/default.conf
@@ -0,0 +1,2 @@
+[BUILDDEB]
+split = True
diff --git a/bileto/models.py b/bileto/models.py
index 5ea297f..a3a5bd2 100644
--- a/bileto/models.py
+++ b/bileto/models.py
@@ -3,7 +3,6 @@
 This file defines the two DB schemas, Request and Comment, and various
 metadata related to those.
 """
-
 import re
 
 from os import environ
@@ -12,6 +11,7 @@ from datetime import datetime
 from functools import lru_cache
 from fcntl import LOCK_EX, LOCK_NB, flock
 
+from qakit.ust.worker import Worker, UstResult
 from sqlalchemy import BigInteger, desc, text
 from sqlalchemy.inspection import inspect
 from sqlalchemy.orm import relationship
@@ -53,6 +53,11 @@ BRITNEY_SIGNOFF = """Automated Signoff
 Indicates if britney has approved the ticket based on autopkgtests & other \
 factors. Check the excuses page for details."""
 
+UST_SIGNOFF = """Ubuntu System Tests Signoff
+
+Indicates if ubuntu system tests has approved the silo"""
+
+
 CREATOR = """Request Creator
 
 Launchpad nickname of the person who created this request."""
@@ -103,6 +108,10 @@ QA = """QA Signoff
 
 Indicates whether or not the ticket has been approved by QA team."""
 
+UST = """UST Signoff
+
+Indicates whether or not the silo has been approved by Ubuntu system tests."""
+
 SERIES = """Target Series
 
 What series to build for, eg, wily, vivid, or yakkety+xenial+vivid."""
@@ -239,6 +248,8 @@ class Request(db.Model, BiletoModel):
     dest = db.Column(db.Text, default=EMPTY, doc=PPA)
     lander_signoff = db.Column(db.Text, default=EMPTY, doc=LANDER_SIGNOFF)
     britney_signoff = db.Column(db.Text, default=EMPTY, doc=BRITNEY_SIGNOFF)
+    ust_signoff = db.Column(db.Text, default=EMPTY, doc=UST_SIGNOFF)
+    ust_build_url = db.Column(db.Text, default=EMPTY, doc=UST_SIGNOFF)
     qa_signoff = db.Column(db.Text, default=EMPTY, doc=QA)
 
     search = db.Column(db.Text, default=EMPTY, doc='Searchable Field')
@@ -329,6 +340,8 @@ class Request(db.Model, BiletoModel):
         if lander_fail or any(clear in status for clear in CLEAR):
             self.lander_signoff = EMPTY
             self.britney_signoff = EMPTY
+            self.ust_signoff = EMPTY
+            self.ust_build_url = EMPTY
             self.qa_signoff = 'Required'
             self.autopkgtest = EMPTY
 
diff --git a/bileto/static/index.html b/bileto/static/index.html
new file mode 100644
index 0000000..9422e18
--- /dev/null
+++ b/bileto/static/index.html
@@ -0,0 +1,285 @@
+<!DOCTYPE html>
+<html ng-app="Bileto" ng-controller="appController">
+<head>
+<meta charset="utf-8" />
+<title>Bileto Landing Tickets</title>
+<link rel="stylesheet" type="text/css" href="/static/style.css">
+<link rel="icon" type="image/gif" href="/static/goldenticket.png">
+<script src="https://ajax.googleapis.com/ajax/libs/angularjs/1.5.0/angular.min.js"></script>
+<script src="https://ajax.googleapis.com/ajax/libs/angularjs/1.5.0/angular-sanitize.min.js"></script>
+<script src="/static/app.js" charset="utf-8"></script>
+</head>
+<body>
+
+<datalist ng-repeat="(list, items) in meta.datalists" id="{{list}}">
+<option ng-repeat="item in items" value="{{item}}" />
+</datalist>
+
+<div id="nav">
+<div id="login">
+<a href="/logout" ng-if="data.nickname">Log out {{data.nickname}}</a>
+<form name="sso_login" action="/login" method=post ng-if="!data.nickname">
+<input type=submit value="Log in with Ubuntu SSO">
+<input type=hidden name=next value="/#{{here}}">
+</form>
+</div>
+<a href="#/create" ng-if="data.nickname">Create New Request</a>
+<a href="#" ng-click="editing = null">All Requests</a>
+<a href="#/silo/landing" ng-click="editing = null">{{data.assigned}} Active</a>
+<a href="#/user/{{data.ircnick}}" ng-click="editing = null" ng-if="data.ircnick">Mine</a>
+<a href="#/failures" ng-click="editing = null">Failures</a>
+<a href="#/tickets?active_only&amp;lander_signoff=Approved" ng-click="editing = null">Lander Approved</a>
+<a href="#/tickets?active_only&amp;qa_signoff=Ready" ng-click="editing = null">Ready for QA</a>
+<a href="#/publishable" ng-click="editing = null">Publishable</a>
+<a href="#/tickets?status=queue" ng-click="editing = null">Queued</a>
+<a href="#/tickets?status=pocket" ng-click="editing = null">Migrating</a>
+<a href="#/tickets?status=Landed" ng-click="editing = null">Landed</a>
+<a href="#/tickets?status=Abandoned" ng-click="editing = null">Abandoned</a>
+<form name="live_search">
+<input type="search" class="search" placeholder="Search..." ng-model="searchstring" />
+<input type="submit" ng-click="search(searchstring)" value="Search All Requests" />
+<input type="submit" ng-click="search(searchstring, true)" value="Search Active Requests" />
+<input type="submit" ng-click="siloname(searchstring)" value="Show PPA #" />
+<input type="submit" ng-click="request(searchstring)" value="Show Ticket #" />
+</form>
+</div>
+
+<div id="body">
+
+<div id="error" ng-if="error">
+<h2>{{error.header}}</h2>
+<img src="/static/error.gif">
+<p>{{error.message}}</p>
+</div>
+
+<div ng-if="data.prev" class="center">
+<a ng-click="prev()">... newer ...</a>
+</div>
+
+<div id="requests">
+<div class="req" ng-repeat="req in data.requests" ng-class="{card: !expand}">
+
+<div class="summary" ng-if="!expand" ng-click="request(req.request_id)">
+<p><span class="{{req.status_color}}" title="{{interpret_color(req.status_color)}}">&nbsp;</span>
+<span class="signoff_{{req.lander_signoff}}" title="Lander {{req.lander_signoff}}">&nbsp;</span>
+<span class="signoff_{{req.britney_signoff}}" title="Britney {{req.britney_signoff}}">&nbsp;</span>
+<span class="signoff_{{req.ust_signoff}}" title="UST {{req.britney_signoff}}">&nbsp;</span>
+<span class="signoff_{{req.qa_signoff}}" title="QA {{req.qa_signoff}}">&nbsp;</span></p>
+<p><a href="#/ticket/{{req.request_id}}">{{req.request_id}}.&nbsp;{{req.date | date:'yyyy-MM-dd'}}&nbsp;{{req.siloname}}</a></p>
+<p>{{req.sources}}</p>
+<p ng-bind-html="linkify(req.description)"></p>
+<p>{{req.landers}}</p>
+</div>
+
+<div class="expanded" ng-if="expand">
+<div class="display" ng-if="!editing">
+<form name="live_edit">
+<table class="details">
+
+<tr>
+<th class="signoff">
+<a target="_blank" href="{{req.job_log}}" ng-if="req.job_log" class="status_details" title="Click for Details">&#187; {{title(meta.docs.status)}}</a>
+<span ng-if="!req.job_log">{{title(meta.docs.status)}}</span>
+</th>
+<td ng-bind-html="display_status(req.status)" class="{{req.status_color}}"></td>
+</tr>
+
+<tr>
+<th class="signoff">{{title(meta.docs.lander_signoff)}}</th>
+<td class="signoff signoff_{{req.lander_signoff}}">
+<select class="signoff signoff_{{req.lander_signoff}}" name="lander_signoff" title="{{meta.docs.lander_signoff}}" ng-change="submit(live_edit, req)" ng-model="req.lander_signoff" ng-options="value for value in meta.datalists.lander_signoff" ng-disabled="!data.teams.length"></select>
+</td>
+</tr>
+
+<tr>
+<th class="signoff">{{title(meta.docs.britney_signoff)}}</th>
+<td class="signoff_{{req.britney_signoff}}">{{req.britney_signoff}}</td>
+</tr>
+
+<tr>
+<th class="signoff">{{title(meta.docs.ust_signoff)}}</th>
+<td>
+<a href="{{req.ust_build_url}}">
+<div class="signoff_{{req.ust_signoff}}">
+{{req.ust_signoff}}
+</div>
+</a>
+</td>
+</tr>
+
+<tr>
+<th class="signoff">{{title(meta.docs.qa_signoff)}}</th>
+<td class="signoff signoff_{{req.qa_signoff}}">
+<select class="signoff signoff_{{req.qa_signoff}}" name="qa_signoff" title="{{meta.docs.qa_signoff}}" ng-change="submit(live_edit, req)" ng-model="req.qa_signoff" ng-options="value for value in meta.datalists.qa_signoff" ng-disabled="!data.admin.length && !req.download_links"></select>
+</td>
+</tr>
+
+<tr>
+<th>{{title(meta.docs.artifacts)}}</th>
+<td ng-bind-html="linkify(req.artifacts)"></td>
+</tr>
+
+<tr ng-if="req.autopkgtest">
+<th>{{title(meta.docs.autopkgtest)}}</th>
+<td ng-bind-html="linkify(req.autopkgtest)"></td>
+</tr>
+
+<tr ng-repeat="field in long_fields">
+<th>{{title(meta.docs[field])}}</th>
+<td ng-bind-html="linkify(req[field])"></td>
+</tr>
+
+<tr>
+<th>{{title(meta.docs.siloname)}}</th>
+<td ng-bind-html="display_siloname(meta.ppa_team, req.siloname)"></td>
+</tr>
+
+<!-- FIXME: sync_request is bit-rotty and doesn't work. disabled for now.
+<tr>
+<th>{{title(meta.docs.sync_request)}}</th>
+<td>{{req.sync_request}}</td>
+</tr>
+-->
+
+<tr>
+<th>{{title(meta.docs.sources)}}</th>
+<td class="sources" ng-bind-html="display_sources(req.sources)"></td>
+</tr>
+
+<tr ng-repeat="field in dropdowns">
+<th>{{title(meta.docs[field])}}</th>
+<td>{{req[field]}}</td>
+</tr>
+
+<tr ng-if="req.series.indexOf('+') === -1">
+<th>{{title(meta.docs.dest)}}</th>
+<td ng-bind-html="display_dest(req.dest)"></td>
+</tr>
+
+<tr>
+<th>{{title(meta.docs.landers)}}</th>
+<td ng-bind-html="display_landers(req.landers)"></td>
+</tr>
+
+<tr>
+<th><a href="#/ticket/{{req.request_id}}">{{title(meta.docs.request_id)}}</a></th>
+<td><a href="#/ticket/{{req.request_id}}">
+<span ng-bind-html="easter_egg(req.request_id)"></span>
+{{req.request_id}}.&nbsp;{{req.date | date:'yyyy-MM-dd'}}
+</a></td>
+</tr>
+
+</table>
+</form>
+</div>
+</div>
+
+<div class="edit" ng-if="editing">
+<form name="edit_request">
+<p>
+<textarea rows="6" name="description"
+          placeholder="{{title(meta.docs.description)}}" title="{{meta.docs.description}}"
+          ng-model="req.description" required>{{req.description}}</textarea>
+</p>
+<p>
+<textarea rows="6" name="test_plan"
+          placeholder="{{title(meta.docs.test_plan)}}" title="{{meta.docs.test_plan}}"
+          ng-model="req.test_plan" required>{{req.test_plan}}</textarea>
+</p>
+<p>
+<textarea rows="6" wrap="off" name="merge_proposals"
+          placeholder="{{title(meta.docs.merge_proposals)}}" title="{{meta.docs.merge_proposals}}"
+          ng-model="req.merge_proposals" ng-pattern="/^((https?:\/\/code.launchpad.net\/~\S+\/\+merge\/\d+|#.*)[\s\n]*)*$/">{{req.merge_proposals}}</textarea>
+</p>
+<p>
+<textarea rows="6" wrap="off" name="download_links"
+          placeholder="{{title(meta.docs.download_links)}}" title="{{meta.docs.download_links}}"
+          ng-model="req.download_links" ng-pattern="/^(https?:\/\/\S+[\s\n]*)*$/">{{req.download_links}}</textarea>
+</p>
+<p>
+<input type="text" name="landers" list="landers" size="10"
+       placeholder="{{title(meta.docs.landers)}}" title="{{meta.docs.landers}}"
+       value="{{req.landers}}" ng-model="req.landers" />
+</p>
+<!-- FIXME: sync_request is bit-rotty and doesn't work. disabled for now.
+<p>
+<input type="text" name="sync_request" list="sync_request" size="10"
+       placeholder="{{title(meta.docs.sync_request)}}" title="{{meta.docs.sync_request}}"
+       value="{{req.sync_request}}" ng-model="req.sync_request"
+       ng-pattern="/^(\d+|\S+,[a-z0-9.]+)$/"/>
+</p>
+-->
+<p>
+<input type="text" name="sources" list="sources" size="10"
+       placeholder="{{title(meta.docs.sources)}}" title="{{meta.docs.sources}}"
+       value="{{req.sources}}" ng-model="req.sources" />
+</p>
+<p ng-repeat="field in dropdowns">
+<select name="{{field}}" title="{{meta.docs[field]}}" ng-model="req[field]" ng-options="value for value in meta.datalists[field]"></select>
+</p>
+<p ng-if="req.series.indexOf('+') === -1">
+<select name="dest" title="{{meta.docs.dest}}" ng-model="req.dest">
+<option value="">Ubuntu Archive</option>
+<option value="ci-train-ppa-service/ubuntu/stable-phone-overlay">Stable Overlay PPA</option>
+</select>
+</p>
+<p>
+<input type="hidden" name="distribution" value="ubuntu" ng-model="req.distribution" />
+<button ng-click="submit(edit_request, req)" ng-disabled="busy || !edit_request.$valid">
+<span ng-if="req.request_id">Save #{{req.request_id}}</span>
+<span ng-if="!req.request_id">Create New Request</span>
+<span ng-if="!edit_request.$valid">(mouse over pink fields for help)</span>
+</button>
+<div class="red" ng-if="display_sru_warning(req)">Warning: Are you sure you want to
+publish an SRU?</div>
+</p>
+</form>
+</div>
+
+<div class="actionbox" ng-if="req.request_id && expand">
+<table class="actions"><tr>
+<td ng-if="!editing"><a href="/log/{{req.request_id}}/build" target="_blank">Build</a></td>
+<td ng-if="req.siloname && !editing"><a href="/log/{{req.request_id}}/diff" target="_blank">Diff</a></td>
+<td ng-if="!editing"><a href="/log/{{req.request_id}}/revert" target="_blank">Revert</a></td>
+<td ng-if="req.siloname && !editing"><a href="/log/{{req.request_id}}/publish" target="_blank">Publish</a></td>
+<td ng-if="!editing"><a href="/log/{{req.request_id}}/finalize" target="_blank">Finalize</a></td>
+<td ng-if="!editing"><a href="/log/{{req.request_id}}/abandon" target="_blank">Abandon</a></td>
+<td ng-if="editing"><a ng-click="cancel()">Cancel Edit</a></td>
+<td ng-if="data.nickname && !editing"><a ng-click="edit(req)">Edit</a></td>
+</tr></table>
+</div>
+
+<div class="comments" ng-if="expand">
+<a ng-click="toggle_log()" ng-if="expand && data.requests[0].comments.length"><span ng-if="!full_log">&#9656;&nbsp;Show</span><span ng-if="full_log">&#9662;&nbsp;Hide</span> Audit Logs</a>
+<div class="comment" ng-repeat="comment in req.comments" ng-if="full_log || !comment.log_url">
+<strong>
+<a target="_blank" href="{{comment.log_url}}" ng-if="comment.log_url">{{comment.date | date:'yyyy-MM-dd HH:mm:ss Z'}} ({{comment.author}})</a>
+<span ng-if="!comment.log_url">{{comment.date | date:'yyyy-MM-dd HH:mm:ss Z'}} ({{comment.author}})</span>
+</strong>
+<span ng-bind-html="display_status(comment.text)"></span>
+</div>
+</div>
+
+<div class="new_comment" ng-if="req.request_id && data.nickname && expand && !editing">
+<form name="new_comment_form">
+<textarea class="commentbox" rows="2" name="comment_text" placeholder="Add a comment..." ng-model="new_comment.text"></textarea>
+<button ng-click="post_comment(req.request_id, new_comment.text)" ng-disabled="busy">Save Comment</button>
+</form>
+</div>
+
+</div>
+
+<div ng-if="data.next" class="center">
+<a ng-click="next()">... older ...</a>
+</div>
+
+<div id="admin">
+<a href="/static/logs.html">All Logs</a>
+<a href="/static/britney/index.html">Britney Files</a>
+<a href="/static/report.txt">Diagnostic Report</a>
+</div>
+
+<div id="busy" ng-if="busy"></div>
+
+</body>
+</html>
diff --git a/bileto/static/style.css b/bileto/static/style.css
new file mode 100644
index 0000000..985e85f
--- /dev/null
+++ b/bileto/static/style.css
@@ -0,0 +1,384 @@
+html, body {
+    background-color: white;
+    color: black;
+    font-family: Ubuntu, Arial, sans-serif;
+    margin: 0;
+    padding: 0;
+}
+
+body {
+    padding-bottom: 1em;
+}
+
+input, select, button, textarea {
+    width: 100%;
+    font-size: medium;
+}
+
+a {
+    color: #dd4814;
+    background-color: white;
+}
+
+a, input[type=submit], select, button, .summary {
+    cursor: pointer;
+    text-decoration: none;
+    outline: 0;
+    margin: 0;
+    border: 0;
+    border-radius: 0;
+    font-size: medium;
+}
+
+#nav {
+    text-align: center;
+    width: auto;
+    float: right;
+}
+
+#body {
+    width: auto;
+    overflow: hidden;
+}
+
+form {
+    display: block;
+    margin: 0;
+    padding: 0;
+    width: 100%;
+}
+
+h1, #nav a, #nav input, .new_comment button, .actions a {
+    background-color: #dd4814;
+    border: 0;
+    color: white;
+    display: block;
+    margin: 0;
+    padding: 1em;
+    text-decoration: none;
+    text-align: center;
+}
+
+.status_details {
+    background-color: #dd4814;
+    color: white;
+    padding: 0.3em;
+}
+
+h1 {
+    font-size: large;
+    text-align: center;
+    width: auto;
+}
+
+th {
+    text-align: right;
+    vertical-align: top;
+    white-space: nowrap;
+    padding-right: 0.5em;
+}
+
+td {
+    vertical-align: top;
+    text-align: left;
+}
+
+#nav input, .new_comment input {
+    width: 100%;
+}
+
+#nav input[type=search] {
+    border-top: 1px solid white;
+}
+
+#nav a:hover, #nav input:hover, h1:hover,
+.edit input[type=submit]:hover, .edit button:hover,
+.new_comment input:hover, .new_comment button:hover,
+.actions a:hover {
+    text-decoration: none;
+    background-color: white;
+    color: #dd4814;
+}
+
+#requests, .display, .edit {
+    display: block;
+}
+
+#requests {
+    padding-top: 2em;
+}
+
+#requests > * {
+    vertical-align: top;
+}
+
+.req {
+    text-align: center;
+}
+
+.edit {
+    margin-top: -2em;
+}
+
+.summary {
+    padding: 0.5em 1em 1em 1em;
+    max-height: 20em;
+}
+
+.summary p {
+    margin: 0.5em;
+}
+
+.display {
+    padding: 1em;
+}
+
+.card {
+    width: 450px;
+    display: inline-block;
+    text-align: left;
+    border-top: 1px solid #ccc;
+    margin: 1em;
+    overflow: auto;
+}
+
+.card, .display {
+    margin-top: 0;
+    padding-top: 0;
+}
+
+.details {
+    width: auto;
+    margin: 0 auto;
+}
+
+.details td, .details th {
+    padding: 0.2em;
+}
+
+td.sources a {
+    display: block;
+}
+
+.center {
+    text-align: center;
+}
+
+input, textarea, button, select {
+    width: 100%;
+    display: block;
+    color: black;
+    background-color: #eee;
+    padding: 0.5em;
+    border: 0;
+    box-sizing: border-box;
+    -webkid-box-sizing: border-box;
+    -moz-box-sizing: border-box;
+}
+
+.edit input[type=submit], .edit button {
+    background-color: #dd4814;
+    color: white;
+    padding: 1em;
+    border: 0;
+}
+
+p {
+    margin: 1em 1em 0 1em;
+}
+
+.comments {
+    display: inline-block;
+    width: auto;
+    padding: 0 2em;
+    margin: 0 auto;
+    text-align: left;
+}
+
+.new_comment {
+    padding: 0;
+    margin: 1em;
+}
+
+table, tr, td {
+    border-collapse: collapse;
+    margin: 0;
+    padding: 0;
+}
+
+table {
+    width: 100%;
+}
+
+.commentbox {
+    width: 100%;
+}
+
+.actionbox {
+    margin: 1em;
+}
+
+table.actions {
+    table-layout: fixed;
+}
+
+table.actions tr, table.actions td {
+    height: 100%;
+    vertical-align: middle;
+}
+
+table.actions a {
+    display: block;
+    width: 100%;
+    height: 100%;
+    padding: 1em 0;
+    vertical-align: middle;
+    box-sizing: border-box;
+    -webkid-box-sizing: border-box;
+    -moz-box-sizing: border-box;
+}
+
+select.signoff {
+    width: auto;
+    display: inline-block;
+}
+
+/* These colors must be kept in sync with $scope.interpret_colors in app.js */
+.black::before, .signoff_::before, .signoff_Required::before,
+.red::before, .signoff_Failed::before,
+.orange::before, .signoff_Queued::before, .signoff_Running::before, .signoff_Ready::before,
+.purple::before,
+.green::before, .signoff_N\/A::before, .signoff_Approved::before,
+.olive::before,
+.blue::before,
+.grey::before {
+    font-size: xx-large;
+    line-height: 0;
+    display: inline-block;
+    text-align: center;
+    width: 1em;
+}
+
+.black, .signoff_, .signoff_Required {
+    color: black;
+}
+
+.black::before, .signoff_::before, .signoff_Required::before {
+    color: black;
+    content: "— ";
+}
+
+.red, .signoff_Failed {
+    color: red;
+    font-weight: bold;
+}
+
+.red::before, .signoff_Failed::before {
+    color: red;
+    content: "✘ ";
+}
+
+.orange, .signoff_Queued, .signoff_Running, .signoff_Ready {
+    color: orange;
+    font-weight: bold;
+}
+
+.orange::before, .signoff_Queued::before, .signoff_Running::before, .signoff_Ready::before {
+    color: orange;
+    content: "⚡ ";
+}
+
+.purple {
+    color: purple;
+}
+
+.purple::before {
+    color: purple;
+    content: "♨ ";
+}
+
+.green, .signoff_N\/A, .signoff_Approved {
+    color: green;
+}
+
+.green::before, .signoff_N\/A::before, .signoff_Approved::before {
+    color: green;
+    content: "✔ ";
+}
+
+.olive {
+    color: olive;
+    font-weight: bold;
+}
+
+.olive::before {
+    color: olive;
+    content: "✱ ";
+}
+
+.blue {
+    color: blue;
+}
+
+.blue::before {
+    color: blue;
+    content: "✔ ";
+}
+
+.grey {
+    color: grey;
+}
+
+.grey::before {
+    color: #888;
+    content: "◌ ";
+}
+
+#busy {
+    background-color: black;
+    color: black;
+    height: 100%;
+    left: 0;
+    margin: 0;
+    opacity: 0.3;
+    padding: 0;
+    position: absolute;
+    top: 0;
+    width: 100%;
+}
+
+.fifty {
+    width: 50%;
+    display: inline-block;
+}
+
+#error {
+    width: 100%;
+    text-align: center;
+}
+
+textarea.ng-invalid, input.ng-invalid {
+    background-color: #ffe5e5;
+}
+
+button[disabled], button[disabled]:hover, button[disabled]:focus, button[disabled]:active,
+select[disabled], select[disabled]:hover, select[disabled]:focus, select[disabled]:active {
+    color: #666;
+    background-color: #ccc;
+    cursor: default;
+}
+
+.signoff {
+    vertical-align: middle;
+}
+
+#admin {
+    margin: 3em 0 0 0;
+    text-align: center;
+    font-size: x-small;
+}
+
+#admin a {
+    margin: 1em;
+    font-size: x-small;
+}
diff --git a/britney/iterate.py b/britney/iterate.py
index edd9b35..08d3bae 100755
--- a/britney/iterate.py
+++ b/britney/iterate.py
@@ -20,6 +20,7 @@ from fcntl import LOCK_EX, LOCK_NB, flock
 from os import unlink, symlink
 from os.path import abspath, dirname, exists
 
+from qakit.ust.worker import UstResult, Worker
 from requests import get, post
 
 HOME = dirname(abspath(__file__))
@@ -179,6 +180,34 @@ def parallelize_fetching(all_series, runs):
         update_request(ticket)
 
 
+def compute_ust_signoff(requests):
+    """Notify the ticket status in ubuntu system tests.
+    Once a silo is assigned to the ticket, ust is triggered only if
+    the lander has approved the ticket. After triggering the tests,
+    the worker is asked for results
+    :return UstResult which has two attributes: status and build url
+    which are both use in the UI"""
+    ust_signoff = None
+    for request in requests:
+        if not request['siloname']:
+            ust_worker = Worker()
+            if request['ust_signoff'] == "":
+                if request['lander_signoff'] == 'Approved':
+                    try:
+                        ust_worker.run_ust(request['siloname'])
+                        ust_signoff = UstResult("Queued", "")
+                    except Exception:
+                        pass
+
+        if ust_signoff:
+            req = dict(
+                author='ust-bot',
+                request_id=request['request_id'],
+                ust_signoff=ust_signoff.status)
+            post(WRITE_API + Config.api_token, dumps(req, sort_keys=True),
+                headers={'content-type': 'application/json'})
+
+
 def print_proc(proc):
     """Print the output from a subprocess."""
     sys.stdout.buffer.write(BNEWLINE.join(
@@ -194,6 +223,7 @@ def main():
         sys.stderr = sys.stdout = open(LOG_NAME, 'x')
         reqs = get_requests()
         parallelize_fetching(*build_siloname_dict(reqs))
+        compute_ust_signoff(reqs)
     except BlockingIOError:
         return 0
     except (IOError, ConnectionRefusedError):
@@ -205,6 +235,5 @@ def main():
         cleanup(lock)
     return 0
 
-
 if __name__ == '__main__':                          # pragma: no cover
     sys.exit(main())
diff --git a/db_migrations.sh b/db_migrations.sh
index e346c14..f6a8b3f 100755
--- a/db_migrations.sh
+++ b/db_migrations.sh
@@ -32,6 +32,7 @@ exit 0
 # These ones have succeeded in production and only kept for reference
 $PG "ALTER TABLE request ADD COLUMN lander_signoff text DEFAULT '';" || true
 $PG "ALTER TABLE request ADD COLUMN britney_signoff text DEFAULT '';" || true
+$PG "ALTER TABLE request ADD COLUMN ust_signoff text DEFAULT '';" || true
 $PG "ALTER TABLE request ADD COLUMN status_color text DEFAULT '';" || true
 $PG "ALTER TABLE request ADD COLUMN artifacts text DEFAULT '';" || true
 
diff --git a/scripts/import.sh b/scripts/import.sh
new file mode 100755
index 0000000..60b8173
--- /dev/null
+++ b/scripts/import.sh
@@ -0,0 +1,26 @@
+#!/bin/sh
+
+# This is a history-destroying git-to-bzr converter,
+# for when you just want the code.
+
+repos="https://github.com/emacs-mirror/emacs.git"
+
+sleep "$(shuf --input-range 0-60 --head-count 1)"
+
+set -eux
+
+
+for repo in $repos; do
+    base="$(basename "$repo" .git)"
+    tmpdir="/tmp/$base"
+
+    [ -d "$tmpdir" ] || git clone --depth 1 "$repo" "$tmpdir"
+    cd "$tmpdir"
+    git pull
+
+    [ -d ".bzr" ] || bzr init .
+    echo '.git*' > .bzrignore
+    bzr add .
+    bzr commit --message "Auto commit $(date)"
+    bzr push "lp:~/$base/imported" --overwrite
+done