Merge lp:~joetalbott/utah/utah-dev_doc-updates into lp:utah

Proposed by Joe Talbott
Status: Merged
Approved by: Javier Collado
Approved revision: 724
Merged at revision: 725
Proposed branch: lp:~joetalbott/utah/utah-dev_doc-updates
Merge into: lp:utah
Diff against target: 160 lines (+90/-18)
2 files modified
docs/source/development.rst (+79/-0)
docs/source/introduction.rst (+11/-18)
To merge this branch: bzr merge lp:~joetalbott/utah/utah-dev_doc-updates
Reviewer Review Type Date Requested Status
Javier Collado (community) Approve
Joe Talbott (community) Needs Resubmitting
Review via email: mp+131271@code.launchpad.net

Description of the change

Update the documentation a bit.

Adds a FAQ section to the development docs.
Moves the reboot section from intro to dev.

To post a comment you must log in.
Revision history for this message
Javier Collado (javier.collado) wrote :

When building the html files, I get some errors because trailing question marks added:

/utah-dev_doc-updates/docs/source/introduction.rst:5: WARNING: Title underline too short.

What is it?
----------
/utah-dev_doc-updates/docs/source/introduction.rst:51: WARNING: Title underline too short.

How does it work?
----------------
/utah-dev_doc-updates/docs/source/introduction.rst:51: WARNING: Title underline too short.

How does it work?
----------------

review: Needs Fixing
Revision history for this message
Javier Collado (javier.collado) wrote :

Aside from the comment above, I think the `FAQ` section should
be on its own instead of below `How do I start developing for it?`,
but I guess is a matter of taste.

Revision history for this message
Joe Talbott (joetalbott) wrote :

> Aside from the comment above, I think the `FAQ` section should
> be on its own instead of below `How do I start developing for it?`,
> but I guess is a matter of taste.

The reason I put it at that level was to avoid having all the FAQ entries show up on the index page. If you know a way around that then I'm happy to have the FAQ be one level higher.

Revision history for this message
Javier Collado (javier.collado) wrote :

Looking at the toctree documentation:
http://sphinx.pocoo.org/concepts.html#dir-toctree

I don't see any way to exclude from the index the children of a specific section.

723. By Joe Talbott

Break FAQ section into pieces and raise its TOC level.

* Add a couple of server/provisioning FAQs while I'm here.

724. By Joe Talbott

Fix build warnings from adding '?'s to questions.

Revision history for this message
Joe Talbott (joetalbott) wrote :

These commits break the FAQ section into pieces which puts it at the top level and fix the errors you were seeing.

review: Needs Resubmitting
Revision history for this message
Javier Collado (javier.collado) wrote :

Since you're today on vacation and the documentation should be up-to-date in UDS,
I've merged the changes and made a small set of changes:

- FAQ section moved to its own file (faq.rst)
- Fixed typo (make is possible -> make it possible)
- Reformatted paragraphs with long lines to fixed width
- Changed some single quotes that were still there (from other commits) to
  double back quotes.

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
1=== modified file 'docs/source/development.rst'
2--- docs/source/development.rst 2012-10-19 16:44:08 +0000
3+++ docs/source/development.rst 2012-10-25 19:16:20 +0000
4@@ -182,6 +182,19 @@
5 **In terms of settings precedence:**
6 The test case control file (``tc_control``) provides the default values for the options available for the testcase. The **overrides** in ``tslist.run`` take precedence over those options in the ``tc_control`` file.
7
8+Running tests that need to reboot
9+---------------------------------
10+
11+In a situation where a reboot is required. This is handled in UTAH by marking a testcase (in the ``tc_control`` file) with::
12+
13+ reboot: <always, pass, never>
14+
15+This will make the **utah client** reboot the system under test at the **end** of the testcase after any ``tc_cleanup`` command has finished. Any thing that needs to be tested after the reboot should be in the testcase immediately following the testcase marked for reboot.
16+
17+The possible choices are ``always``, ``pass``, and ``never``. ``never`` is the default and simply means the system under test will not reboot. ``pass`` means the reboot will only happen if the testcase passes. ``always``, means just that, the reboot will happen even if the test fails.
18+
19+Some things to keep in mind. The **utah-client** resumes by replacing ``/etc/rc.local`` with a file that will resume the current run and will resume with the testcase following the one that triggered the reboot. Also note that in order to have both pre- and post-reboot logging the ``-o`` flag should be used so that post-reboot output will be appended to the pre-reboot output.
20+
21 How to use custom preseeds
22 --------------------------
23
24@@ -236,6 +249,70 @@
25 used in the future as well to catch some of the errors/warnings that might not
26 be detected by flake8_.
27
28+Frequently Asked Questions
29+==========================
30+
31+UTAH Client FAQ
32+---------------
33+
34+How do I install the client?
35+~~~~~~~~~~~~~~~~~~~~~~~~~~~~
36+
37+::
38+
39+ sudo apt-add-repository ppa:utah/stable
40+ sudo apt-get update
41+ sudo apt-get install utah-client
42+
43+Is there an example testsuite I can look at?
44+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
45+
46+There is an `example testsuite`_.
47+
48+How do I run the utah-client locally?
49+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
50+
51+::
52+
53+ sudo utah -r <master.run>
54+
55+Why are there so many control files?
56+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
57+
58+The goal of UTAH is to make sharing and reusing testsuites and
59+testcases as easy as possible. The control files make is possible to
60+define testcases and testsuites fully and allow a third party using a
61+testsuite or testcase the control they need to run the them in their
62+own environment and to suit their own needs.
63+
64+Can I run the utah client on a local testsuite?
65+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
66+
67+You can, but it must be in a supported (``bzr``, ``git``) local repository.
68+
69+Why doesn't the utah client support running a testsuite in the current directory or a local copy?
70+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
71+
72+In order to maintain tracability utah needs to know which version of a testsuite was run. This is the reason we require testsuites be in a VCS. This makes troubleshooting test failures and reproducing test runs in other environments much easier and more reliable.
73+
74+How do I get help with writing or migrating my tests to UTAH?
75+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
76+
77+Send an email to ubuntu-utah-devel@lists.ubuntu.com and we will be happy to help you.
78+
79+UTAH Server FAQ
80+---------------
81+
82+What provisioning methods are currently supported?
83+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
84+
85+Virtual machines via ``kvm`` and ``qemu`` are currently supported and physical machines via ``cobbler``. The physical machine support is specific to the Ubuntu Engineering QA Lab setup.
86+
87+Do you support provisioning LXC, existing VMS, of other methods?
88+~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
89+
90+Not at this time. There are plans for adding new provisioning methods and we'd be happy to review merge proposals. The branch is in launchpad under the UTAH_ project.
91+
92 .. _Guido van Rossum: https://en.wikipedia.org/wiki/Guido_van_Rossum
93 .. _Barry Warsaw: http://barry.warsaw.us/
94 .. _static code analysis: https://en.wikipedia.org/wiki/Static_program_analysis
95@@ -246,3 +323,5 @@
96 .. _Google Python Style Guide:
97 http://google-styleguide.googlecode.com/svn/trunk/pyguide.html
98 .. _pylint: http://pypi.python.org/pypi/pylint/
99+.. _example testsuite: https://code.launchpad.net/~utah/utah/utah_ls_example
100+.. _UTAH: https://code.launchpad.net/~utah/utah/dev
101
102=== modified file 'docs/source/introduction.rst'
103--- docs/source/introduction.rst 2012-10-19 19:29:42 +0000
104+++ docs/source/introduction.rst 2012-10-25 19:16:20 +0000
105@@ -1,8 +1,8 @@
106 Introduction
107 ============
108
109-What is it
110-----------
111+What is it?
112+-----------
113
114 The `Ubuntu Test Automation Harness`_ introduces new way of creating
115 *end-to-end* automated test cases without having to worry about the
116@@ -47,8 +47,8 @@
117 test cases, the developer will just need to put the right make files and
118 control files in the right places for this to happen smoothly.
119
120-How does it work
121-----------------
122+How does it work?
123+-----------------
124
125 UTAH is very simple in terms of testing reliably and being able to reproduce a
126 test run in a consistent manner. A command line specifies the test
127@@ -73,8 +73,8 @@
128 The harness allows users to build test cases and run them, some control files
129 are required so that the harness knows how to deal with the code.
130
131-How to start running tests
132-----------------------------
133+How to start running tests?
134+---------------------------
135
136 There are some dependencies that need to be met in order to test with VMs, in a
137 nutshell::
138@@ -135,17 +135,10 @@
139 /usr/share/utah/client/examples/master.run \
140 'http://people.canonical.com/~max/max_test.run'
141
142-Running tests that need to reboot
143-=================================
144-
145-In a situation where a reboot is required. This is handled in UTAH by marking a testcase (in the ``tc_control`` file) with::
146-
147- reboot: <always, pass, never>
148-
149-This will make the **utah client** reboot the system under test at the **end** of the testcase after any ``tc_cleanup`` command has finished. Any thing that needs to be tested after the reboot should be in the testcase immediately following the testcase marked for reboot.
150-
151-The possible choices are ``always``, ``pass``, and ``never``. ``never`` is the default and simply means the system under test will not reboot. ``pass`` means the reboot will only happen if the testcase passes. ``always``, means just that, the reboot will happen even if the test fails.
152-
153-Some things to keep in mind. The **utah-client** resumes by replacing ``/etc/rc.local`` with a file that will resume the current run and will resume with the testcase following the one that triggered the reboot. Also note that in order to have both pre- and post-reboot logging the ``-o`` flag should be used so that post-reboot output will be appended to the pre-reboot output.
154+How to start writing tests?
155+---------------------------
156+
157+See the development_ documentation for guidance on writing and adapting tests to run under UTAH.
158
159 .. _Ubuntu Test Automation Harness: https://launchpad.net/utah
160+.. _development: development.html

Subscribers

People subscribed via source and target branches