Merge lp:~joetalbott/utah/utah-dev_doc-updates into lp:utah

Proposed by Joe Talbott
Status: Merged
Approved by: Javier Collado
Approved revision: 724
Merged at revision: 725
Proposed branch: lp:~joetalbott/utah/utah-dev_doc-updates
Merge into: lp:utah
Diff against target: 160 lines (+90/-18)
2 files modified
docs/source/development.rst (+79/-0)
docs/source/introduction.rst (+11/-18)
To merge this branch: bzr merge lp:~joetalbott/utah/utah-dev_doc-updates
Reviewer Review Type Date Requested Status
Javier Collado (community) Approve
Joe Talbott (community) Needs Resubmitting
Review via email: mp+131271@code.launchpad.net

Description of the change

Update the documentation a bit.

Adds a FAQ section to the development docs.
Moves the reboot section from intro to dev.

To post a comment you must log in.
Revision history for this message
Javier Collado (javier.collado) wrote :

When building the html files, I get some errors because trailing question marks added:

/utah-dev_doc-updates/docs/source/introduction.rst:5: WARNING: Title underline too short.

What is it?
----------
/utah-dev_doc-updates/docs/source/introduction.rst:51: WARNING: Title underline too short.

How does it work?
----------------
/utah-dev_doc-updates/docs/source/introduction.rst:51: WARNING: Title underline too short.

How does it work?
----------------

review: Needs Fixing
Revision history for this message
Javier Collado (javier.collado) wrote :

Aside from the comment above, I think the `FAQ` section should
be on its own instead of below `How do I start developing for it?`,
but I guess is a matter of taste.

Revision history for this message
Joe Talbott (joetalbott) wrote :

> Aside from the comment above, I think the `FAQ` section should
> be on its own instead of below `How do I start developing for it?`,
> but I guess is a matter of taste.

The reason I put it at that level was to avoid having all the FAQ entries show up on the index page. If you know a way around that then I'm happy to have the FAQ be one level higher.

Revision history for this message
Javier Collado (javier.collado) wrote :

Looking at the toctree documentation:
http://sphinx.pocoo.org/concepts.html#dir-toctree

I don't see any way to exclude from the index the children of a specific section.

723. By Joe Talbott

Break FAQ section into pieces and raise its TOC level.

* Add a couple of server/provisioning FAQs while I'm here.

724. By Joe Talbott

Fix build warnings from adding '?'s to questions.

Revision history for this message
Joe Talbott (joetalbott) wrote :

These commits break the FAQ section into pieces which puts it at the top level and fix the errors you were seeing.

review: Needs Resubmitting
Revision history for this message
Javier Collado (javier.collado) wrote :

Since you're today on vacation and the documentation should be up-to-date in UDS,
I've merged the changes and made a small set of changes:

- FAQ section moved to its own file (faq.rst)
- Fixed typo (make is possible -> make it possible)
- Reformatted paragraphs with long lines to fixed width
- Changed some single quotes that were still there (from other commits) to
  double back quotes.

review: Approve

Preview Diff

[H/L] Next/Prev Comment, [J/K] Next/Prev File, [N/P] Next/Prev Hunk
=== modified file 'docs/source/development.rst'
--- docs/source/development.rst 2012-10-19 16:44:08 +0000
+++ docs/source/development.rst 2012-10-25 19:16:20 +0000
@@ -182,6 +182,19 @@
182**In terms of settings precedence:**182**In terms of settings precedence:**
183The test case control file (``tc_control``) provides the default values for the options available for the testcase. The **overrides** in ``tslist.run`` take precedence over those options in the ``tc_control`` file.183The test case control file (``tc_control``) provides the default values for the options available for the testcase. The **overrides** in ``tslist.run`` take precedence over those options in the ``tc_control`` file.
184184
185Running tests that need to reboot
186---------------------------------
187
188In a situation where a reboot is required. This is handled in UTAH by marking a testcase (in the ``tc_control`` file) with::
189
190 reboot: <always, pass, never>
191
192This will make the **utah client** reboot the system under test at the **end** of the testcase after any ``tc_cleanup`` command has finished. Any thing that needs to be tested after the reboot should be in the testcase immediately following the testcase marked for reboot.
193
194The possible choices are ``always``, ``pass``, and ``never``. ``never`` is the default and simply means the system under test will not reboot. ``pass`` means the reboot will only happen if the testcase passes. ``always``, means just that, the reboot will happen even if the test fails.
195
196Some things to keep in mind. The **utah-client** resumes by replacing ``/etc/rc.local`` with a file that will resume the current run and will resume with the testcase following the one that triggered the reboot. Also note that in order to have both pre- and post-reboot logging the ``-o`` flag should be used so that post-reboot output will be appended to the pre-reboot output.
197
185How to use custom preseeds198How to use custom preseeds
186--------------------------199--------------------------
187200
@@ -236,6 +249,70 @@
236used in the future as well to catch some of the errors/warnings that might not249used in the future as well to catch some of the errors/warnings that might not
237be detected by flake8_.250be detected by flake8_.
238251
252Frequently Asked Questions
253==========================
254
255UTAH Client FAQ
256---------------
257
258How do I install the client?
259~~~~~~~~~~~~~~~~~~~~~~~~~~~~
260
261::
262
263 sudo apt-add-repository ppa:utah/stable
264 sudo apt-get update
265 sudo apt-get install utah-client
266
267Is there an example testsuite I can look at?
268~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
269
270There is an `example testsuite`_.
271
272How do I run the utah-client locally?
273~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
274
275::
276
277 sudo utah -r <master.run>
278
279Why are there so many control files?
280~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
281
282The goal of UTAH is to make sharing and reusing testsuites and
283testcases as easy as possible. The control files make is possible to
284define testcases and testsuites fully and allow a third party using a
285testsuite or testcase the control they need to run the them in their
286own environment and to suit their own needs.
287
288Can I run the utah client on a local testsuite?
289~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
290
291You can, but it must be in a supported (``bzr``, ``git``) local repository.
292
293Why doesn't the utah client support running a testsuite in the current directory or a local copy?
294~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
295
296In order to maintain tracability utah needs to know which version of a testsuite was run. This is the reason we require testsuites be in a VCS. This makes troubleshooting test failures and reproducing test runs in other environments much easier and more reliable.
297
298How do I get help with writing or migrating my tests to UTAH?
299~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
300
301Send an email to ubuntu-utah-devel@lists.ubuntu.com and we will be happy to help you.
302
303UTAH Server FAQ
304---------------
305
306What provisioning methods are currently supported?
307~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
308
309Virtual machines via ``kvm`` and ``qemu`` are currently supported and physical machines via ``cobbler``. The physical machine support is specific to the Ubuntu Engineering QA Lab setup.
310
311Do you support provisioning LXC, existing VMS, of other methods?
312~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
313
314Not at this time. There are plans for adding new provisioning methods and we'd be happy to review merge proposals. The branch is in launchpad under the UTAH_ project.
315
239.. _Guido van Rossum: https://en.wikipedia.org/wiki/Guido_van_Rossum316.. _Guido van Rossum: https://en.wikipedia.org/wiki/Guido_van_Rossum
240.. _Barry Warsaw: http://barry.warsaw.us/317.. _Barry Warsaw: http://barry.warsaw.us/
241.. _static code analysis: https://en.wikipedia.org/wiki/Static_program_analysis318.. _static code analysis: https://en.wikipedia.org/wiki/Static_program_analysis
@@ -246,3 +323,5 @@
246.. _Google Python Style Guide:323.. _Google Python Style Guide:
247 http://google-styleguide.googlecode.com/svn/trunk/pyguide.html324 http://google-styleguide.googlecode.com/svn/trunk/pyguide.html
248.. _pylint: http://pypi.python.org/pypi/pylint/325.. _pylint: http://pypi.python.org/pypi/pylint/
326.. _example testsuite: https://code.launchpad.net/~utah/utah/utah_ls_example
327.. _UTAH: https://code.launchpad.net/~utah/utah/dev
249328
=== modified file 'docs/source/introduction.rst'
--- docs/source/introduction.rst 2012-10-19 19:29:42 +0000
+++ docs/source/introduction.rst 2012-10-25 19:16:20 +0000
@@ -1,8 +1,8 @@
1Introduction1Introduction
2============2============
33
4What is it4What is it?
5----------5-----------
66
7The `Ubuntu Test Automation Harness`_ introduces new way of creating7The `Ubuntu Test Automation Harness`_ introduces new way of creating
8*end-to-end* automated test cases without having to worry about the8*end-to-end* automated test cases without having to worry about the
@@ -47,8 +47,8 @@
47test cases, the developer will just need to put the right make files and47test cases, the developer will just need to put the right make files and
48control files in the right places for this to happen smoothly.48control files in the right places for this to happen smoothly.
4949
50How does it work50How does it work?
51----------------51-----------------
5252
53UTAH is very simple in terms of testing reliably and being able to reproduce a53UTAH is very simple in terms of testing reliably and being able to reproduce a
54test run in a consistent manner. A command line specifies the test54test run in a consistent manner. A command line specifies the test
@@ -73,8 +73,8 @@
73The harness allows users to build test cases and run them, some control files73The harness allows users to build test cases and run them, some control files
74are required so that the harness knows how to deal with the code.74are required so that the harness knows how to deal with the code.
7575
76How to start running tests76How to start running tests?
77----------------------------77---------------------------
7878
79There are some dependencies that need to be met in order to test with VMs, in a79There are some dependencies that need to be met in order to test with VMs, in a
80nutshell::80nutshell::
@@ -135,17 +135,10 @@
135 /usr/share/utah/client/examples/master.run \135 /usr/share/utah/client/examples/master.run \
136 'http://people.canonical.com/~max/max_test.run'136 'http://people.canonical.com/~max/max_test.run'
137137
138Running tests that need to reboot138How to start writing tests?
139=================================139---------------------------
140140
141In a situation where a reboot is required. This is handled in UTAH by marking a testcase (in the ``tc_control`` file) with::141See the development_ documentation for guidance on writing and adapting tests to run under UTAH.
142
143 reboot: <always, pass, never>
144
145This will make the **utah client** reboot the system under test at the **end** of the testcase after any ``tc_cleanup`` command has finished. Any thing that needs to be tested after the reboot should be in the testcase immediately following the testcase marked for reboot.
146
147The possible choices are ``always``, ``pass``, and ``never``. ``never`` is the default and simply means the system under test will not reboot. ``pass`` means the reboot will only happen if the testcase passes. ``always``, means just that, the reboot will happen even if the test fails.
148
149Some things to keep in mind. The **utah-client** resumes by replacing ``/etc/rc.local`` with a file that will resume the current run and will resume with the testcase following the one that triggered the reboot. Also note that in order to have both pre- and post-reboot logging the ``-o`` flag should be used so that post-reboot output will be appended to the pre-reboot output.
150142
151.. _Ubuntu Test Automation Harness: https://launchpad.net/utah143.. _Ubuntu Test Automation Harness: https://launchpad.net/utah
144.. _development: development.html

Subscribers

People subscribed via source and target branches