Merge lp:~rodsmith/checkbox/new-cpu-test into lp:checkbox

[Rod Smith]

New CPU stress test based on Colin King's stress_ng tool rather than the older stress tool.

[Rod Smith (rodsmith)]

Oh, I forgot: Here's some sample output (from a run tweaked to run for 60 seconds rather than 2 hours):

https://certification.canonical.com/hardware/201005-5725/submission/108362/test/62532/result/7946686/

[Jeff Lane  (bladernr)]

Looks good to me

review: Approve

=== added file 'providers/plainbox-provider-checkbox/bin/cpu_stress'
--- providers/plainbox-provider-checkbox/bin/cpu_stress	1970-01-01 00:00:00 +0000
+++ providers/plainbox-provider-checkbox/bin/cpu_stress	2016-02-03 20:14:27 +0000
@@ -0,0 +1,70 @@
+#!/bin/sh
+
+# Script to perform CPU stress tests
+#
+# Copyright (c) 2016 Canonical Ltd.
+#
+# Authors
+#   Rod Smith <[e-mail]>
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU General Public License version 3,
+# as published by the Free Software Foundation.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+#
+# The purpose of this script is to run CPU stress tests using the
+# stress-ng program.
+#
+# Usage:
+#   cpu_stress [ --runtime <time-in-seconds> ]
+#
+# If --runtime is not specified, it defaults to 7200 (2 hours).
+
+runtime=7200
+if [ "$#" = "2" ] && [ "$1" = "--runtime" ] && [ "$2" -eq "$2" ] ; then
+    runtime=$2
+elif [ "$#" != "0" ] ; then
+    echo "Usage:"
+    echo " $0 [ --runtime <time-in-seconds> ]"
+    exit 1
+fi
+echo "Setting run time to $runtime seconds"
+# Add 10% to runtime; will forcefully terminate if stress-ng
+# fails to return in that time.
+end_time=$((runtime*11/10))
+
+# NOTE:
+# Options --af-alg 0 through --wcs 0 specify CPU stressors. As of stress-ng
+# version 0.05.12, this is equivalent to --class cpu --all 0 --exclude numa,cpu_online.
+# This script specifies stressors individually because the list of stressors keeps
+# increasing, and we want consistency -- if the stress-ng version bumps up, we
+# don't want new stressors being run. We're omitting numa because it's most
+# useful on systems with massive numbers of CPUs, and cpu_online because it's
+# failed on 4 of 8 test systems, so it seems too strict.
+# Use "timeout" command to launch stress-ng, to catch it should it go into la-la land
+timeout -s 9 $end_time stress-ng --aggressive --verify --timeout $runtime \
+                                 --metrics-brief --tz --times \
+                                 --af-alg 0 --bsearch 0 --context 0 --cpu 0 \
+                                 --crypt 0 --hsearch 0 --longjmp 0 --lsearch 0 \
+                                 --matrix 0 --qsort 0 --str 0 --stream 0 \
+                                 --tsearch 0 --vecmath 0 --wcs 0
+result="$?"
+
+echo "**********************************************************"
+if [ $result = "0" ] ; then
+    echo "* stress-ng CPU test passed!"
+else
+    if [ $result = "137" ] ; then
+        echo "* stress-ng CPU test timed out and was forcefully terminated!"
+    fi
+    echo "* stress-ng CPU test failed with result $result"
+fi
+echo "**********************************************************"
+exit $result

=== modified file 'providers/plainbox-provider-checkbox/jobs/stress.txt.in'
--- providers/plainbox-provider-checkbox/jobs/stress.txt.in	2015-12-17 15:51:40 +0000
+++ providers/plainbox-provider-checkbox/jobs/stress.txt.in	2016-02-03 20:14:27 +0000
@@ -13,6 +13,19 @@
 
 plugin: shell
 category_id: 2013.com.canonical.plainbox::stress
+id: stress/cpu_stress_ng_test
+estimated_duration: 7200.0
+requires:
+ package.name == 'stress-ng'
+user: root
+command: cpu_stress --runtime 7200
+_description:
+ Impose a high system load using the 'stress_ng' tool to exercise the CPU for
+ several hours. The test is considered passed if the system does not freeze and
+ if the stress_ng tool does not report errors.
+
+plugin: shell
+category_id: 2013.com.canonical.plainbox::stress
 id: power-management/hibernate_30_cycles
 estimated_duration: 5400.00
 depends: