Merge lp:~cjohnston/ubuntu-ci-services-itself/generic-doc-fixes into lp:ubuntu-ci-services-itself

Proposed by Chris Johnston
Status: Merged
Approved by: Francis Ginther
Approved revision: 136
Merged at revision: 136
Proposed branch: lp:~cjohnston/ubuntu-ci-services-itself/generic-doc-fixes
Merge into: lp:ubuntu-ci-services-itself
Diff against target: 344 lines (+41/-42)
12 files modified
docs/api/initial-request.rst (+3/-3)
docs/components/branch-source-builder.rst (+4/-4)
docs/components/existing-pieces.rst (+2/-2)
docs/components/image-builder.rst (+2/-2)
docs/components/lander.rst (+8/-8)
docs/components/planned.rst (+0/-1)
docs/components/queue-service.rst (+1/-1)
docs/components/test-runner.rst (+2/-2)
docs/components/ticket-system.rst (+10/-10)
docs/introduction.rst (+3/-3)
docs/ticket.rst (+4/-4)
docs/usage.rst (+2/-2)
To merge this branch: bzr merge lp:~cjohnston/ubuntu-ci-services-itself/generic-doc-fixes
Reviewer Review Type Date Requested Status
Francis Ginther Approve
Review via email: mp+203151@code.launchpad.net

Commit message

Misc doc fixes across the board

Description of the change

Just general doc fixes across the board

To post a comment you must log in.
Revision history for this message
Francis Ginther (fginther) wrote :

Thanks for the fixes.

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
=== modified file 'docs/api/initial-request.rst'
--- docs/api/initial-request.rst 2014-01-16 22:29:43 +0000
+++ docs/api/initial-request.rst 2014-01-24 18:34:54 +0000
@@ -10,7 +10,7 @@
1010
11::11::
1212
13 make_request autopilot_1.5~dev.1_source.changes --addpkgs python-autopilot python3-autopilot13 python ubuntu-ci create_ticket -t "Ticket name" -d "Ticket description" -b 123 -o user@example.com -a "foo,bar" -r "baz" -s /full/path/to/_source.changes -s /full/path/to/_source.changes
1414
15CLI -> Ticket System15CLI -> Ticket System
16--------------------16--------------------
@@ -264,14 +264,14 @@
264-----------------------264-----------------------
265265
266The lander provides progress to the ticket system through the ticket266The lander provides progress to the ticket system through the ticket
267system's progress api:267system's progress API:
268268
269::269::
270270
271 TBD271 TBD
272272
273Completion of a build is provided to the ticket system through the ticket273Completion of a build is provided to the ticket system through the ticket
274system's progress api:274system's progress API:
275275
276::276::
277277
278278
=== modified file 'docs/components/branch-source-builder.rst'
--- docs/components/branch-source-builder.rst 2014-01-17 20:11:51 +0000
+++ docs/components/branch-source-builder.rst 2014-01-24 18:34:54 +0000
@@ -22,7 +22,7 @@
22************22************
2323
24* Lander sends a "build_source" request to the service (this includes swift24* Lander sends a "build_source" request to the service (this includes swift
25 urls from the data-store on what to build)25 URLs from the data-store on what to build)
2626
27* A request is placed in the queue (at each step below, the progress_trigger27* A request is placed in the queue (at each step below, the progress_trigger
28 will be called to notify of status changes).28 will be called to notify of status changes).
@@ -46,12 +46,12 @@
4646
47Request a PPA build of the provided sources.47Request a PPA build of the provided sources.
4848
49*Url Pattern*49*URL Pattern*
5050
51 http://bsbuilder-url:8080/api/v1/build_source (HTTP POST)51 http://bsbuilder-url:8080/api/v1/build_source (HTTP POST)
5252
53*Parameters*53*Parameters*
54 * source_packages: An array of data-store URL's containing all of the54 * source_packages: An array of data-store URLs containing all of the
55 source package files.55 source package files.
56 * ppa: The PPA allocated by the ppa-assigner for this operation.56 * ppa: The PPA allocated by the ppa-assigner for this operation.
57 * progress_trigger: A string used to create a dedicated message queue57 * progress_trigger: A string used to create a dedicated message queue
@@ -116,7 +116,7 @@
116Useful for debug and monitoring. This method will return information like116Useful for debug and monitoring. This method will return information like
117the number of worker queues and if they are busy or not.117the number of worker queues and if they are busy or not.
118118
119*Url Pattern*119*URL Pattern*
120120
121 http://bsbuilder-url:8080/api/v1/status (HTTP GET)121 http://bsbuilder-url:8080/api/v1/status (HTTP GET)
122122
123123
=== modified file 'docs/components/existing-pieces.rst'
--- docs/components/existing-pieces.rst 2014-01-21 15:09:33 +0000
+++ docs/components/existing-pieces.rst 2014-01-24 18:34:54 +0000
@@ -16,7 +16,7 @@
1616
17**Project Manager**17**Project Manager**
1818
19* Project specific configuration - We are doing this now with lp:cupstream2distro-config but with a very jenkins focused implementation.19* Project specific configuration - We are doing this now with lp:cupstream2distro-config but with a very Jenkins focused implementation.
2020
21**Test Runner**21**Test Runner**
2222
@@ -25,7 +25,7 @@
2525
26**Image Building**26**Image Building**
2727
28* Didier has done this manually for ISO images, using a squash FS process. Need to automate this and modify to work with touch images (which have an ubuntu and platform specific component). (takes about 15 minutes)28* Didier has done this manually for ISO images, using a squash FS process. Need to automate this and modify to work with touch images (which have an Ubuntu and platform specific component). (takes about 15 minutes)
2929
30**Ubuntu CD Image & Germinate**30**Ubuntu CD Image & Germinate**
3131
3232
=== modified file 'docs/components/image-builder.rst'
--- docs/components/image-builder.rst 2014-01-21 14:56:40 +0000
+++ docs/components/image-builder.rst 2014-01-24 18:34:54 +0000
@@ -12,7 +12,7 @@
12Deployment12Deployment
13----------13----------
1414
15* Can run as a juju service.15* Can run as a Juju service.
16* Needs relationship to the Lander and the Data Store.16* Needs relationship to the Lander and the Data Store.
17* Operations are transient, no need to save state.17* Operations are transient, no need to save state.
18* Will need to have some configuration data though, in particular, for18* Will need to have some configuration data though, in particular, for
@@ -48,7 +48,7 @@
48 * base_image : {"image_type": IMAGE_TYPE, "url_list": [...], "series": SERIES}48 * base_image : {"image_type": IMAGE_TYPE, "url_list": [...], "series": SERIES}
4949
50 * A json object containing the image_type (cloud for now), list of50 * A json object containing the image_type (cloud for now), list of
51 URLs pointing to the image artifact(s), and the ubuntu series51 URLs pointing to the image artifact(s), and the Ubuntu series
52 name.52 name.
53 53
54 * ppa_list : [...]54 * ppa_list : [...]
5555
=== modified file 'docs/components/lander.rst'
--- docs/components/lander.rst 2014-01-21 15:09:33 +0000
+++ docs/components/lander.rst 2014-01-24 18:34:54 +0000
@@ -26,7 +26,7 @@
26Phase 026Phase 0
27-------27-------
2828
29* Can run as a juju service.29* Can run as a Juju service.
30* Needs relationship to Ticket System, PPA Assigner, Branch/Source Builder,30* Needs relationship to Ticket System, PPA Assigner, Branch/Source Builder,
31 Image Builder and Test Runner.31 Image Builder and Test Runner.
32* No public access needed.32* No public access needed.
@@ -109,27 +109,27 @@
109109
110A Lander service handles the workflow by using Jenkins to schedule individual110A Lander service handles the workflow by using Jenkins to schedule individual
111tasks. When a request is received to the Lander from the Ticket System, it111tasks. When a request is received to the Lander from the Ticket System, it
112triggers the master jenkins job with the request parameters. The master job112triggers the master Jenkins job with the request parameters. The master job
113then triggers a series of child jobs to execute the workflow.113then triggers a series of child jobs to execute the workflow.
114114
115The child jobs themselves execute a service handler. The service handler is115The child jobs themselves execute a service handler. The service handler is
116responsible for setting up the progress queue and triggering the service116responsible for setting up the progress queue and triggering the service
117via its REST API. As the service handler runs, it outputs the progress updates117via its REST API. As the service handler runs, it outputs the progress updates
118it receives to the console (to be viewed via jenkins) and pushes the progress118it receives to the console (to be viewed via Jenkins) and pushes the progress
119update to the Ticket System.119update to the Ticket System.
120120
121When the service completes, the service handler closes with a return code121When the service completes, the service handler closes with a return code
122matching the status of the service itself. The result data from the service is122matching the status of the service itself. The result data from the service is
123archived as a jenkins artifact. That data is combined with the existing set of123archived as a Jenkins artifact. That data is combined with the existing set of
124job parameters to be used as input to the next jenkins child job.124job parameters to be used as input to the next Jenkins child job.
125125
126Only one master job may execute at a time. If additional build requests are126Only one master job may execute at a time. If additional build requests are
127received, they will be queued by jenkins.127received, they will be queued by Jenkins.
128128
129The Lander supplies regular notification events to the Ticket System while a129The Lander supplies regular notification events to the Ticket System while a
130job is executing. There are no notifications sent when the service is idle.130job is executing. There are no notifications sent when the service is idle.
131131
132The Lander archives the jenkins console logs and the archived results of each132The Lander archives the Jenkins console logs and the archived results of each
133job to the data store.133job to the data store.
134134
135Future135Future
@@ -151,7 +151,7 @@
151Schedules a new request for building source packages and creation and test of151Schedules a new request for building source packages and creation and test of
152an image.152an image.
153153
154*Url Pattern*154*URL Pattern*
155155
156 http://lander-url:8080/api/v1/execute_request (HTTP POST)156 http://lander-url:8080/api/v1/execute_request (HTTP POST)
157157
158158
=== modified file 'docs/components/planned.rst'
--- docs/components/planned.rst 2014-01-14 02:44:54 +0000
+++ docs/components/planned.rst 2014-01-24 18:34:54 +0000
@@ -5,7 +5,6 @@
5 :maxdepth: 25 :maxdepth: 2
66
7 ticket-system7 ticket-system
8 ticket-manager
9 web-server8 web-server
10 branch-listener9 branch-listener
11 ppa-assigner10 ppa-assigner
1211
=== modified file 'docs/components/queue-service.rst'
--- docs/components/queue-service.rst 2013-12-09 20:06:06 +0000
+++ docs/components/queue-service.rst 2014-01-24 18:34:54 +0000
@@ -4,7 +4,7 @@
4Purpose4Purpose
5*******5*******
66
7Provides a generic queue service for the entire CI engine. Common uses are:7Provides a generic queue service for the entire CI Engine. Common uses are:
88
9 * Task queues to manage work between a service accepting requests and a pool9 * Task queues to manage work between a service accepting requests and a pool
10 of workers to actually execute the request.10 of workers to actually execute the request.
1111
=== modified file 'docs/components/test-runner.rst'
--- docs/components/test-runner.rst 2014-01-21 16:10:57 +0000
+++ docs/components/test-runner.rst 2014-01-24 18:34:54 +0000
@@ -10,7 +10,7 @@
10Future10Future
11======11======
1212
13Expands upon phase 0 by allowing a set of ppas and additional packages to be13Expands upon phase 0 by allowing a set of PPAs and additional packages to be
14added before running the tests, support using autopilot on a touch device,14added before running the tests, support using autopilot on a touch device,
15perform a custom test (TBD), support executing tests on bare metal.15perform a custom test (TBD), support executing tests on bare metal.
1616
@@ -85,7 +85,7 @@
8585
86* Setup an instance from the image builder url86* Setup an instance from the image builder url
87* Run the dep8 tests87* Run the dep8 tests
88* Collecte the artifacts88* Collect the artifacts
89* Send test results and artifacts to the lander (via the data store).89* Send test results and artifacts to the lander (via the data store).
9090
91Future91Future
9292
=== modified file 'docs/components/ticket-system.rst'
--- docs/components/ticket-system.rst 2014-01-21 19:36:04 +0000
+++ docs/components/ticket-system.rst 2014-01-24 18:34:54 +0000
@@ -442,14 +442,14 @@
442442
443::443::
444444
445 curl --dump-header - -H "Content-Type: application/json" -X POST --data '{"name": "Chris Johnston", "email": "chris.johnston@canonical.com", "is_team": "False"}' http://localhost:8000/api/v1/person/445 curl --dump-header - -H "Content-Type: application/json" -X POST --data '{"name": "Chris Johnston", "email": "user@example.com", "is_team": "False"}' http://localhost:8000/api/v1/person/
446446
447447
448*team*448*team*
449449
450::450::
451451
452 curl --dump-header - -H "Content-Type: application/json" -X POST --data '{"name": "Canonical CI Engineering", "email": "canonical-ci-engineering@lists.launchpad.net", "is_team": "True"}' http://localhost:8000/api/v1/person/452 curl --dump-header - -H "Content-Type: application/json" -X POST --data '{"name": "Canonical CI Engineering", "email": "team@lists.example", "is_team": "True"}' http://localhost:8000/api/v1/person/
453453
454454
455get_person455get_person
@@ -465,19 +465,19 @@
465465
466::466::
467467
468 curl --dump-header - http://localhost:8000/api/v1/person/?name__exact=Chris%20Johnston468 curl --dump-header - http://localhost:8000/api/v1/person/?name__exact=My%20Name
469 curl --dump-header - http://localhost:8000/api/v1/person/?name__iexact=chris%20johnston469 curl --dump-header - http://localhost:8000/api/v1/person/?name__iexact=my%20name
470 curl --dump-header - http://localhost:8000/api/v1/person/?name__startswith=Chris470 curl --dump-header - http://localhost:8000/api/v1/person/?name__startswith=My
471 curl --dump-header - http://localhost:8000/api/v1/person/?name__istartswith=chris471 curl --dump-header - http://localhost:8000/api/v1/person/?name__istartswith=my
472472
473*search by email*473*search by email*
474474
475::475::
476476
477 curl --dump-header - http://localhost:8000/api/v1/person/?email__exact=chris.johnston@canonical.com477 curl --dump-header - http://localhost:8000/api/v1/person/?email__exact=user@example.com
478 curl --dump-header - http://localhost:8000/api/v1/person/?email__iexact=Chris.Johnston@canonical.com478 curl --dump-header - http://localhost:8000/api/v1/person/?email__iexact=User@example.com
479 curl --dump-header - http://localhost:8000/api/v1/person/?email__startswith=chris479 curl --dump-header - http://localhost:8000/api/v1/person/?email__startswith=user
480 curl --dump-header - http://localhost:8000/api/v1/person/?email__istartswith=Chris480 curl --dump-header - http://localhost:8000/api/v1/person/?email__istartswith=User
481481
482*show/don't show teams*482*show/don't show teams*
483483
484484
=== modified file 'docs/introduction.rst'
--- docs/introduction.rst 2014-01-23 19:06:13 +0000
+++ docs/introduction.rst 2014-01-24 18:34:54 +0000
@@ -28,12 +28,12 @@
2828
29The essiential set of Phase 0 features include:29The essiential set of Phase 0 features include:
3030
31 * CI from debian source packages.31 * CI from Debian source packages.
32 * Building of binary packages and complete images.32 * Building of binary packages and complete images.
33 * Tests are executed on the produced image.33 * Tests are executed on the produced image.
34 * Tests are defined via autopackage testing.34 * Tests are defined via autopackage testing.
35 * Results are archived and retrieved via a web interface.35 * Results are archived and retrieved via a web interface.
36 * A micro-service oriented architecture deployed in an openstack cloud36 * A micro-service oriented architecture deployed in an OpenStack cloud
37 environment.37 environment.
3838
39Constraints39Constraints
@@ -49,7 +49,7 @@
49 * Build and test results and logs are provided as raw artifacts.49 * Build and test results and logs are provided as raw artifacts.
50 * Source packages are used is input.50 * Source packages are used is input.
51 * Binary packages and images are built from a default series and image.51 * Binary packages and images are built from a default series and image.
52 * Openstack cloud images are produced and used for testing.52 * OpenStack cloud images are produced and used for testing.
53 * Tests are limited to autopackage tests defined in the source packages.53 * Tests are limited to autopackage tests defined in the source packages.
5454
55Future Phases55Future Phases
5656
=== modified file 'docs/ticket.rst'
--- docs/ticket.rst 2013-11-19 19:13:56 +0000
+++ docs/ticket.rst 2014-01-24 18:34:54 +0000
@@ -20,15 +20,15 @@
20* knowing where we stands on all those feature branches and sources compared to latest in distro (if the source package isn't the latest version in the development version anymore)20* knowing where we stands on all those feature branches and sources compared to latest in distro (if the source package isn't the latest version in the development version anymore)
21* what MP are pending against this ticket, meaning against all attached feature branches.21* what MP are pending against this ticket, meaning against all attached feature branches.
22* what delta do we have between the various feature branches in this ticket and their corresponding trunks.22* what delta do we have between the various feature branches in this ticket and their corresponding trunks.
23* knowing if we are mergeable or not against those trunks. If we can merge at a T time (and tests are all passing), propose a way to merge trunks easily into those branches.23* knowing if we are able to merge or not against those trunks. If we can merge at a T time (and tests are all passing), propose a way to merge trunks easily into those branches.
24* after getting the progress on their build, attaching latest available specific image (3 images per ticket): feature branch + fixed image number, feature branch + latest available image, trunk + feature branch merged + latest available image.24* after getting the progress on their build, attaching latest available specific image (3 images per ticket): feature branch + fixed image number, feature branch + latest available image, trunk + feature branch merged + latest available image.
25* knowing what latest image number is available, be able to change with it if test on latest image passed.25* knowing what latest image number is available, be able to change with it if test on latest image passed.
26* getting tests progress while they are run dynamically. Represents them clearly against those previous 3 image tests26* getting tests progress while they are run dynamically. Represents them clearly against those previous 3 image tests
27* ensuring that involved parties like core-devs and design team are involved if the ticket needs their review. A packaging change will require core-devs to ack their change. The design team will be in the process if there is a design change involved. Those should work through credentials.27* ensuring that involved parties like core-devs and design team are involved if the ticket needs their review. A packaging change will require core-devs to ack their change. The design team will be in the process if there is a design change involved. Those should work through credentials.
28* CI general health and global warnings if needed28* CI general health and global warnings if needed
29* status on the corresponding components health29* status on the corresponding components health
30* gives an easy way once all those criterias are met (third-party acking, everything built and all tests passing) to give a "go" to the engine to deliver those different trunks.30* gives an easy way once all those criteria are met (third-party acking, everything built and all tests passing) to give a "go" to the engine to deliver those different trunks.
31* show the progress on the merging back to trunk, building packages there, tests passing, migration in UNAPPROVED/NEW, -proposed, release pocket and close the ticket completely once the next image is kicked in. Demonstrate explicitely when something is blocking there the whole pipeline for other delivery.31* show the progress on the merging back to trunk, building packages there, tests passing, migration in UNAPPROVED/NEW, -proposed, release pocket and close the ticket completely once the next image is kicked in. Demonstrate explicitly when something is blocking there the whole pipeline for other delivery.
3232
33**Tickets interactions**33**Tickets interactions**
3434
@@ -39,7 +39,7 @@
39Finally, in this global view, we want to show the health of all projects:39Finally, in this global view, we want to show the health of all projects:
4040
41* seeing all components (projects/branches) that we have in the CI system with global/general metadata (what test environment is going to be used, what tests are associated with that components, number of tickets opened against them and so on)41* seeing all components (projects/branches) that we have in the CI system with global/general metadata (what test environment is going to be used, what tests are associated with that components, number of tickets opened against them and so on)
42* giving a view for the managers to see what ticket their team are working on, and what's the progress on them as well as global status (build/tests/mergeable to trunk).42* giving a view for the managers to see what ticket their team are working on, and what's the progress on them as well as global status (build/tests/ability to merge to trunk).
43* if a direct commit to trunk blocked the project and that's the only way to fix it back (another direct commit to trunk), surface that. All other tickets being blocked by that state (as touching that same component) should reflect that info as well.43* if a direct commit to trunk blocked the project and that's the only way to fix it back (another direct commit to trunk), surface that. All other tickets being blocked by that state (as touching that same component) should reflect that info as well.
44* when tickets are expected to be delivered (based on the ETA), so that we can identify hot spots (times where a lot of landing will happen simultaneously and will clash) and try to shuffle them around to not having them in one landing (eventually by a global override on all tickets)44* when tickets are expected to be delivered (based on the ETA), so that we can identify hot spots (times where a lot of landing will happen simultaneously and will clash) and try to shuffle them around to not having them in one landing (eventually by a global override on all tickets)
45* a single point to see across all projects where different teams need to assess/review before the delivery takes place (pending packaging changes triggering a core-dev review, design review needed)45* a single point to see across all projects where different teams need to assess/review before the delivery takes place (pending packaging changes triggering a core-dev review, design review needed)
4646
=== modified file 'docs/usage.rst'
--- docs/usage.rst 2014-01-23 19:06:13 +0000
+++ docs/usage.rst 2014-01-24 18:34:54 +0000
@@ -10,7 +10,7 @@
1010
11CI requests, known as tickets, are created through a command line interface. ::11CI requests, known as tickets, are created through a command line interface. ::
1212
13 make_request my_source_package_1.0.1_source.changes --addpkgs my_binary_package13 python ubuntu-ci create_ticket -t "Ticket name" -d "Ticket description" -b 123 -o user@example.com -a "foo,bar" -r "baz" -s /full/path/to/_source.changes -s /full/path/to/_source.changes
1414
15This returns a ticket ID which can later be used to monitor and check for15This returns a ticket ID which can later be used to monitor and check for
16results. Once the ticket is created, the Ubuntu CI Engine does the rest. The16results. Once the ticket is created, the Ubuntu CI Engine does the rest. The
@@ -33,7 +33,7 @@
33Specification of a source package33Specification of a source package
34~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~34~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
3535
36A source package is a standard debian source package which may optionally36A source package is a standard Debian source package which may optionally
37contain dep8 autopackage tests. If autopackage tests are defined, they will37contain dep8 autopackage tests. If autopackage tests are defined, they will
38be used to validate the image that is produced. All tests must pass for a38be used to validate the image that is produced. All tests must pass for a
39ticket to complete CI successfully.39ticket to complete CI successfully.

Subscribers

People subscribed via source and target branches