Merge lp:~fagerstedt-axel/lava-android-test/linaro-android-kernel-test into lp:lava-android-test

[Axel Fagerstedt]

Adds a new test, linaro_android_kernel_test, this will run all the linaro android kernel unit tests.

Ashmemtest is removed as it will be run by the new test.

[Michael Hudson-Doyle (mwhudson)]

Seems reasonable to me. Could these tests be run with lava-test-shell?
That's becoming the prefered way to do things if you don't need to
fiddle with adb specifically.

[Axel Fagerstedt (fagerstedt-axel)]

It would absolutely make sense to run it as lava-test-shell

Last I head android-build does not yet support posting lava-test-shell jobs (being worked on) so I did this first, next step will be to publish a lava-test-shell definition.

[Yongqin Liu (liuyq0307)]

Hi, Axel

just some questions:
1. is the linaro-android-kernel-tests.sh integrated into the build?
2. could you list some output to help to check if the pattern is right?
3. The following two lines should be unnecessary.
93 +import lava_android_test.testdef
95 +test_name = 'linaro_android_kernel_test'

[Axel Fagerstedt (fagerstedt-axel)]

1. yes (in the juice builds)

2. here is some example output (I have tested the parsing locally)

Running basic ashmemtest.
0 [ashmem_basic]: test passed

Running expanded ashmemtest.
running test0
-> got 1000 pages -> unpin 0..500 OK ret 0 -> pin 0..500 OK ret 0
[test0]: test passed

Running alarm dev test.
Error opening /dev/alarm
[alarmdevtest]: test failed

3. verifying and will upload a updated version shortly

[lp:~fagerstedt-axel/lava-android-test/linaro-android-kernel-test]

237. By Axel Fagerstedt on 2013-02-26

linaro_android_kernel_test cleanup

[Yongqin Liu (liuyq0307)]

liuyq> from the output, seem the result gotten by the pattern is failed or passed.
<liuyq> I am not very sure if the result of failed or passed can be accepted
<liuyq> could you help to run "lava-android-test run command-linaro_android_kernel_test -o result.json", and see if we can get the result in the result.json file?
<liuyq> if the command works well, then the source should be ok

And maybe we can rename the file name to kernel.py from linaro_android_kernel_test.py for a short.

[Yongqin Liu (liuyq0307)]

<axelfagerstedt> I would prefer not to rename the suite to kernel.py as i believe there are other linaro test suites testing kernel functionality. This one is specifically testing android drivers.

review: Approve

=== modified file 'doc/tests.rst'
--- doc/tests.rst	2013-01-21 18:02:32 +0000
+++ doc/tests.rst	2013-02-26 08:42:20 +0000
@@ -22,7 +22,7 @@
  * `v8`_
  * `wifi`_
  * `0xbench`_
- * `ashmemtest`_
+ * `linaro_android_kernel_test`_
  * `commands`_
  * `instruments`_
  * `hostshells`_
@@ -88,9 +88,9 @@
 ++++
 .. automodule:: lava_android_test.test_definitions.wifi
 
-ashmemtest
+linaro_android_kernel_test
 ++++++++
-.. automodule:: lava_android_test.test_definitions.commands.ashmemtest
+.. automodule:: lava_android_test.test_definitions.commands.linaro_android_kernel_test
 
 commands
 ++++++++

=== removed file 'lava_android_test/test_definitions/commands/ashmemtest.py'
--- lava_android_test/test_definitions/commands/ashmemtest.py	2013-02-01 17:09:26 +0000
+++ lava_android_test/test_definitions/commands/ashmemtest.py	1970-01-01 00:00:00 +0000
@@ -1,32 +0,0 @@
-# Copyright (c) 2012 Linaro
-
-# Author: Linaro Validation Team <[e-mail]>
-#
-# This file is part of LAVA Android Test.
-#
-#
-# This program is free software: you can redistribute it and/or modify
-# it under the terms of the GNU General Public License as published by
-# the Free Software Foundation, either version 3 of the License, or
-# (at your option) any later version.
-#
-# This program is distributed in the hope that it will be useful,
-# but WITHOUT ANY WARRANTY; without even the implied warranty of
-# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
-# GNU General Public License for more details.
-#
-# You should have received a copy of the GNU General Public License
-# along with this program.  If not, see <http://www.gnu.org/licenses/>.
-"""
-Runs the basic and expanded unit tests for the ashmem driver.
-
-**URL:**  None
-
-**Default Options:** None
-"""
-import lava_android_test.testdef
-
-test_name = 'ashmem'
-
-RUN_ADB_SHELL_STEPS = ['ashmemtest', 'ashmemtest-expanded-runner.sh']
-PATTERN = "\s*\[(?P<test_case_id>\w+)\]:\s\w+\s(?P<result>\w+)"

=== added file 'lava_android_test/test_definitions/commands/linaro_android_kernel_test.py'
--- lava_android_test/test_definitions/commands/linaro_android_kernel_test.py	1970-01-01 00:00:00 +0000
+++ lava_android_test/test_definitions/commands/linaro_android_kernel_test.py	2013-02-26 08:42:20 +0000
@@ -0,0 +1,29 @@
+# Copyright (c) 2012 Linaro
+
+# Author: Linaro Validation Team <[e-mail]>
+#
+# This file is part of LAVA Android Test.
+#
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+"""
+Runs the linaro kernel unit tests
+
+**URL:**  None
+
+**Default Options:** None
+"""
+
+RUN_ADB_SHELL_STEPS = ['linaro-android-kernel-tests.sh']
+PATTERN = "\s*\[(?P<test_case_id>\w+)\]:\s\w+\s(?P<result>\w+)"