Merge lp:~linaro-infrastructure/cbuild/cbuild-lava into lp:cbuild

[Stevan Radaković]

This branch contains all the changes on the CBuild build scripts for the CBuild/LAVA integration.
Materials in the branch include: changes to CBuild makefiles to make them more suitable for development/testing (like, more verbose output), scripts to bootstrap local devel environment, LAVA job definition and scripts, instructions and notes.

[Milo Casagrande (milo)]

I'm going through the code, also to get to know it, one small suggestion:

431 +ROOTFS_URL=http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/linaro-o-nano-tar-20120221-0.tar.gz
432 +ROOTFS=$(basename $ROOTFS_URL)
433 +HWPACK_URL=http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/hwpack_linaro-lt-panda_20120221-1_armel_supported.tar.gz
434 +HWPACK=$(basename $HWPACK_URL)

Why not extract also the release number (12.10) and the date (20120221) and set two variables for those? Might be easier in the future to just update that and might give a little bit of meaning to the URLs.

[Milo Casagrande (milo)]

I saw also that there are commented parts that are still included: should those be cleaned up as well or do we want to keep them for reference?

[Stevan Radaković (stevanr)]

> I'm going through the code, also to get to know it, one small suggestion:
>
> 431 +ROOTFS_URL=http://releases.linaro.org/12.02/ubuntu/oneiric-
> images/nano/linaro-o-nano-tar-20120221-0.tar.gz
> 432 +ROOTFS=$(basename $ROOTFS_URL)
> 433 +HWPACK_URL=http://releases.linaro.org/12.02/ubuntu/oneiric-
> images/nano/hwpack_linaro-lt-panda_20120221-1_armel_supported.tar.gz
> 434 +HWPACK=$(basename $HWPACK_URL)
>
> Why not extract also the release number (12.10) and the date (20120221) and
> set two variables for those? Might be easier in the future to just update that
> and might give a little bit of meaning to the URLs.

Good suggestion. Please feel free to add the variables :)

[Stevan Radaković (stevanr)]

> I saw also that there are commented parts that are still included: should
> those be cleaned up as well or do we want to keep them for reference?

Yes, let's keep them in for now, and clean up in the last iteration before handing over the MP's to tcwg team.

[lp:~linaro-infrastructure/cbuild/cbuild-lava]

424. By Milo Casagrande on 2013-01-09

Defined two variables, for release and date, to be used in URLs.

[Milo Casagrande (milo)]

On Wed, Jan 9, 2013 at 4:35 PM, Stevan Radaković
<email address hidden> wrote:
>
> Good suggestion. Please feel free to add the variables :)

That's done.

--
Milo Casagrande | Infrastructure Team
Linaro.org <www.linaro.org> │ Open source software for ARM SoCs

[Paul Sokolovsky (pfalcon)]

Sorry guys, I should have looked thru this earlier to avoid doing unneeded work on this...

This was a first repo to be worked on, and by the end of milestone of 1, there was just too many hacks/support tools so I decided to commit it as is to share with James. Most of this content is clearly not suitable for merging upstream. Basicly, there're 2 upstream-useful changes in here:

1. lava build slave support config/utils in slaves/lava-build/ (local.mk, workaround-multiarch.sh , but not most of other changes) - these clearly should land in upstream
2. cbuild makefiles patches to make build process more verbose - these wouldn't be needed for perfect-running production, but we're far from it, instead we're getting build lockups now, so it's hell to debug stuff w/o these.

So, it probably makes sense to start from scratch and extract just needed changes to a fresh branch. Let me do this (I'll inlude "2." changes based on the above). The rest of stuff still may be useful, but not in upstream (leaving it in this branch is ok; probably doesn't need to spend time on refactoring it).

[Paul Sokolovsky (pfalcon)]

Ok, new branch is at https://code.launchpad.net/~linaro-infrastructure/cbuild/cbuild-lava2

Rest of branches were updated to use it, lava-panda-mock was tested to work ok.

Going to close this review and submit new one for TCWG.

Unmerged revisions

424. By Milo Casagrande on 2013-01-09

Defined two variables, for release and date, to be used in URLs.

423. By Stevan Radaković on 2013-01-08

Merge from upstream.

422. By Paul Sokolovsky on 2012-12-10

[merge] Merge from upstream.

421. By Paul Sokolovsky on 2012-12-10

Wrap line to easy reading/copy-pasting.

420. By Paul Sokolovsky on 2012-12-04

Typo fix.

419. By Paul Sokolovsky on 2012-12-04

Add jobdefs for mock build, for local and prod LAVA.

418. By Paul Sokolovsky on 2012-12-04

Autoselect mock tarball location for QEMU/real builds.

This is done by checking for Beagle hw and not thus not 100% reliable.

417. By Paul Sokolovsky on 2012-12-04

Re-enable error handling.

416. By Paul Sokolovsky on 2012-12-04

More debugging.

415. By Paul Sokolovsky on 2012-12-04

Shuffle to make it "pass" on production.

=== modified file 'README'
--- README	2012-11-11 21:10:10 +0000
+++ README	2013-01-09 16:07:23 +0000
@@ -20,7 +20,9 @@
  * libnet-ssleay-perl
 
 Or, as one line:
- sudo apt-get install time python-irclib wget gnupg ccrypt rsync coreutils sendemail bzr xdelta3 xz-utils unzip openssh-client libio-socket-ssl-perl libnet-ssleay-perl
+ sudo apt-get install time python-irclib wget gnupg ccrypt rsync \
+ coreutils sendemail bzr xdelta3 xz-utils unzip openssh-client \
+ libio-socket-ssl-perl libnet-ssleay-perl
 
 Build dependencies:
  * gcc

=== modified file 'lib/fetch.mk'
--- lib/fetch.mk	2012-12-11 02:53:15 +0000
+++ lib/fetch.mk	2013-01-09 16:07:23 +0000
@@ -16,7 +16,8 @@
 fetch: $(F)
 
 %.tar:
-	$(MAKE) $(SILENT) -f $(THIS) $@-spawn 2>&1 | grep -v '^make\['
+#	$(MAKE) $(SILENT) -f $(THIS) $@-spawn 2>&1 | grep -v '^make\['
+	$(MAKE) $(SILENT) -f $(THIS) $@-spawn
 
 %.tar.xz.cpt %.tar.bz2.cpt::
 	$(MAKE) $(SILENT) -f $(THIS) $@-get-top 2>&1 | grep -v '^make\['

=== modified file 'lib/gcc.mk'
--- lib/gcc.mk	2012-12-16 23:57:18 +0000
+++ lib/gcc.mk	2013-01-09 16:07:23 +0000
@@ -80,7 +80,9 @@
 	(cd $(VBUILD)/build && ../../gcc-*4.*/configure $(CONFIGURE_FLAGS)) >> $(STEP).txt 2>&1
 
 build:
-	make -k $(PARALLEL) -C $(VBUILD)/build $(BUILDTARGET) $(GCC_BUILD_FLAGS) > $(STEP).txt 2>&1
+#	make -k $(PARALLEL) -C $(VBUILD)/build $(BUILDTARGET) $(GCC_BUILD_FLAGS) > $(STEP).txt 2>&1
+	make -k $(PARALLEL) -C $(VBUILD)/build $(BUILDTARGET) $(GCC_BUILD_FLAGS) 2>&1 | tee $(STEP).txt
+
 
 post-archive:
 	make -f $(LIBDIR)/publish.mk SUITE=$(B) binary-only

=== added directory 'slaves/lava-build'
=== added file 'slaves/lava-build/README'
--- slaves/lava-build/README	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/README	2013-01-09 16:07:23 +0000
@@ -0,0 +1,64 @@
+1. Install lava-dispatcher per instructions at
+http://lava-dispatcher.readthedocs.org/en/latest/standalonesetup.html
+except use "LAVA_IMAGE_TMPDIR = /tmp/lava".
+
+Update .venv/etc/lava-dispatcher/lava-dispatcher.conf so LAVA_SERVER_IP
+matches the IP address of your development machine.
+
+2. Configure Pandaboard for lava-dispatcher per instructions at
+http://lava.readthedocs.org/en/latest/lava-image-creation.html ,
+except that use following partitions sizes to generate master image:
+
+./lava-create-master --rootfs-size 5G --userdata-size 1G panda
+
+(at least 8Gb card is required).
+
+Note that as we are working in a virtualenv, the path to panda01.conf is:
+.venv/etc/lava-dispatcher/devices/panda01.conf
+
+3. Create build image:
+
+In the directory lava-build-slave/slaves/lava-build
+./make-build-img.sh
+
+3. Run "init.sh" in this directory to setup directory structure.
+
+4. Set up a web server, serving files in /tmp/lava such that the variable
+LAVA_IMAGE_URL in .venv/etc/lava-dispatcher/lava-dispatcher.conf points to
+the running server.
+
+For example, you can run a Node.js static server:
+-------------------------------------------------------------------------------
+var http = require('http'),
+    static = require('node-static');
+
+// Create a node-static server instance to serve static files.
+var file = new(static.Server)('/tmp/lava');
+
+require('http').createServer(function (request, response)
+{
+  request.addListener('end', function ()
+  {
+    // Serve files!
+    file.serve(request, response);
+  });
+
+}).listen(10101);
+-------------------------------------------------------------------------------
+And set: LAVA_IMAGE_URL = http://%(LAVA_SERVER_IP)s:10101/
+
+Or set up Apache:
+-------------------------------------------------------------------------------
+Alias /images/tmp /tmp/lava
+<Directory /tmp/lava>
+    Options Indexes FollowSymLinks
+</Directory>
+-------------------------------------------------------------------------------
+And set: LAVA_IMAGE_URL = http://%(LAVA_SERVER_IP)s/images/tmp
+
+5. Switch back to lava-dispatcher, and as root (with virtualenv active) run:
+
+This will not work using sudo, you need a root prompt and to then re-source
+the virtualenv set up scripts.
+
+./lava-dispatch /tmp/lava/cbuild-gcc-panda.json.prebuilt

=== added file 'slaves/lava-build/cbuild-gcc-mockbuild.yaml'
--- slaves/lava-build/cbuild-gcc-mockbuild.yaml	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-mockbuild.yaml	2013-01-09 16:07:23 +0000
@@ -0,0 +1,49 @@
+metadata:
+    format: "Lava-Test Test Definition 1.0"
+    name: "cbuild-gcc"
+
+install:
+        bzr-repos:
+            - lp:~linaro-infrastructure/cbuild/lava-build-slave
+        steps:
+            - echo In Install
+            #- "apt-get update"
+            #- "apt-get install -y build-essential gdb lsb-release time python-irclib wget gnupg ccrypt rsync coreutils sendemail bzr xdelta3 xz-utils unzip openssh-client libio-socket-ssl-perl libnet-ssleay-perl"
+            #- "apt-get install -y build-essential gdb lsb-release time wget coreutils bzr xz-utils unzip openssh-client"
+            # LAVA Debugging
+            #- apt-get install -y openssh-server
+            # - "apt-get build-dep -y gcc gcc-4.5 gdb eglibc"
+            #- "apt-get build-dep -y gcc gcc-4.5"
+            #- "cd lava-build-slave/slaves/lava-build"
+            #- "./workaround-multiarch.sh"
+            - cd lava-build-slave/slaves/lava-build
+            - apt-get install -y wget
+            - if grep -q Beagle /proc/cpuinfo; then
+            - "    # if it's supposed QEMU, download from local server"
+            -     url="http://10.0.2.2/images/tmp/gcc-linaro-4.6-2012.09-results.tar.gz"
+            - else
+            -     url="http://people.linaro.org/~pfalcon/cbuild-lava/gcc-linaro-4.6-2012.09-results.tar.gz"
+            - fi
+            - wget -q -O- $url | gzip -d -c | tar -x
+run:
+    steps:
+        - set -x
+#        - set +e
+        - echo In run
+        - "cd lava-build-slave/slaves/lava-build"
+        #- "make -f ../../lib/build.mk final/gcc-linaro-4.6-2012.09.stamp"
+        - cat `which lava-test-case`
+        - lava-test-case gcc-configure --result pass
+        - lava-test-case gcc-build --result pass
+        - lava-test-case gcc-install --result pass
+        - lava-test-case cbuild-global --result pass
+#        - echo "some log" >log.txt
+        - lava-test-case-attach gcc-configure results/build/*/logs/*/gcc-configure.txt
+        - lava-test-case-attach gcc-build results/build/*/logs/*/gcc-build.txt
+        - lava-test-case-attach gcc-install results/build/*/logs/*/gcc-install.txt
+        - lava-test-case-attach cbuild-global results/build/*/logs/*/gcc-build.time
+        - lava-test-case-attach cbuild-global results/build/*/logs/*/gcc-archive.time
+        - lava-test-case-attach cbuild-global results/build/*/logs/*/host.txt
+        - lava-test-case-attach cbuild-global results/build/*/logs/*/md5sums.txt
+        - lava-test-case-attach cbuild-global results/build/*/logs/*/finished.txt
+        - echo after recording testcase

=== added file 'slaves/lava-build/cbuild-gcc-panda-mockbuild.json'
--- slaves/lava-build/cbuild-gcc-panda-mockbuild.json	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-panda-mockbuild.json	2013-01-09 16:07:23 +0000
@@ -0,0 +1,28 @@
+{
+  "timeout": 1800,
+  "job_name": "cbuild-test",
+  "device_type": "panda",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "rootfs": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/linaro-o-nano-tar-20120221-0.tar.gz",
+            "hwpack": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/hwpack_linaro-lt-panda_20120221-1_armel_supported.tar.gz"
+         }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["http://bazaar.launchpad.net/~linaro-infrastructure/cbuild/lava-build-slave/download/head:/cbuildgccmockbuild.y-20121203143817-4nl23ftkflqqeu9d-1/cbuild-gcc-mockbuild.yaml"],
+            "timeout": 36000
+        }
+    },
+    {
+         "command": "submit_results",
+         "parameters": {
+             "stream": "/anonymous/cbuild/",
+             "server": "http://validation.linaro.org/lava-server/RPC2/"
+         }
+    }
+  ]
+}

=== added file 'slaves/lava-build/cbuild-gcc-panda.json'
--- slaves/lava-build/cbuild-gcc-panda.json	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-panda.json	2013-01-09 16:07:23 +0000
@@ -0,0 +1,22 @@
+{
+  "timeout": 1800,
+  "job_name": "cbuild-test",
+  "target" : "panda01",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "rootfs": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/linaro-o-nano-tar-20120221-0.tar.gz",
+            "hwpack": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/hwpack_linaro-lt-panda_20120221-1_armel_supported.tar.gz"
+         }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["file:///tmp/lava/cbuild-gcc.yaml"],
+            "timeout": 36000
+        }
+    }
+  ]
+}
+

=== added file 'slaves/lava-build/cbuild-gcc-panda.json.prebuilt'
--- slaves/lava-build/cbuild-gcc-panda.json.prebuilt	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-panda.json.prebuilt	2013-01-09 16:07:23 +0000
@@ -0,0 +1,21 @@
+{
+  "timeout": 1800,
+  "job_name": "cbuild-test",
+  "target" : "panda01",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "image": "file:///tmp/lava/cbuild.img.gz"
+         }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["file:///tmp/lava/cbuild-gcc.yaml"],
+            "timeout": 36000
+        }
+    }
+  ]
+}
+

=== added file 'slaves/lava-build/cbuild-gcc-panda.json.scheduler'
--- slaves/lava-build/cbuild-gcc-panda.json.scheduler	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-panda.json.scheduler	2013-01-09 16:07:23 +0000
@@ -0,0 +1,29 @@
+{
+  "timeout": 1800,
+  "job_name": "cbuild-test",
+  "device_type": "panda",
+  "_target" : "panda01",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "rootfs": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/linaro-o-nano-tar-20120221-0.tar.gz",
+            "hwpack": "http://releases.linaro.org/12.02/ubuntu/oneiric-images/nano/hwpack_linaro-lt-panda_20120221-1_armel_supported.tar.gz"
+         }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["http://bazaar.launchpad.net/~linaro-infrastructure/cbuild/lava-build-slave/download/head:/cbuildgcc.yaml-20121119214634-8f2eh0mv446fgtmj-4/cbuild-gcc.yaml"],
+            "timeout": 36000
+        }
+    },
+    {
+         "command": "submit_results",
+         "parameters": {
+             "stream": "/anonymous/cbuild/",
+             "server": "http://validation.linaro.org/lava-server/RPC2/"
+         }
+    }
+  ]
+}

=== added file 'slaves/lava-build/cbuild-gcc-prod.yaml'
--- slaves/lava-build/cbuild-gcc-prod.yaml	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-prod.yaml	2013-01-09 16:07:23 +0000
@@ -0,0 +1,23 @@
+metadata:
+    format: "Lava-Test Test Definition 1.0"
+    name: "cbuild-gcc"
+
+install:
+        bzr-repos:
+            - lp:~linaro-infrastructure/cbuild/lava-build-slave
+        steps:
+            #- "apt-get update"
+            #- "apt-get install -y build-essential gdb lsb-release time python-irclib wget gnupg ccrypt rsync coreutils sendemail bzr xdelta3 xz-utils unzip openssh-client libio-socket-ssl-perl libnet-ssleay-perl"
+            #- "apt-get install -y build-essential gdb lsb-release time wget coreutils bzr xz-utils unzip openssh-client"
+            # LAVA Debugging
+            - apt-get install -y openssh-server
+            # - "apt-get build-dep -y gcc gcc-4.5 gdb eglibc"
+            #- "apt-get build-dep -y gcc gcc-4.5"
+            #- "cd lava-build-slave/slaves/lava-build"
+            #- "./workaround-multiarch.sh"
+run:
+    steps:
+        - "cd lava-build-slave/slaves/lava-build"
+        - "make -f ../../lib/build.mk final/gcc-linaro-4.6-2012.09.stamp"
+
+parse:

=== added file 'slaves/lava-build/cbuild-gcc-qemu-mockbuild.json'
--- slaves/lava-build/cbuild-gcc-qemu-mockbuild.json	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-qemu-mockbuild.json	2013-01-09 16:07:23 +0000
@@ -0,0 +1,27 @@
+{
+  "timeout": 1800,
+  "job_name": "cbuild-test",
+  "device_type": "qemu",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "image": "file:///tmp/lava/beagle-nano.img.gz"
+        }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["file:///tmp/lava/cbuild-gcc-mockbuild.yaml"],
+            "timeout": 36000
+        }
+    },
+    {
+         "command": "submit_results",
+         "parameters": {
+             "stream": "/anonymous/cbuild/",
+             "server": "http://localhost/cbuild/RPC2/"
+         }
+    }
+  ]
+}

=== added file 'slaves/lava-build/cbuild-gcc-qemu.json'
--- slaves/lava-build/cbuild-gcc-qemu.json	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc-qemu.json	2013-01-09 16:07:23 +0000
@@ -0,0 +1,21 @@
+{
+  "timeout": 1800,
+  "job_name": "qemutest",
+  "target" : "qemu01",
+  "actions": [
+    {
+        "command": "deploy_linaro_image",
+        "parameters": {
+            "image": "file:///home/pfalcon/devel/linaro/lava/beagle-nano_.img"
+         }
+    },
+    {
+        "command": "lava_test_shell",
+        "parameters": {
+            "testdef_urls": ["file:///tmp/lava/cbuild-gcc.yaml"],
+            "timeout": 36000
+        }
+    }
+  ]
+}
+

=== added file 'slaves/lava-build/cbuild-gcc.yaml'
--- slaves/lava-build/cbuild-gcc.yaml	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/cbuild-gcc.yaml	2013-01-09 16:07:23 +0000
@@ -0,0 +1,23 @@
+metadata:
+    format: "Lava-Test Test Definition 1.0"
+    name: "cbuild-gcc"
+
+install:
+        bzr-repos:
+            - lp:~linaro-infrastructure/cbuild/lava-build-slave
+        steps:
+            - "apt-get update"
+            #- "apt-get install -y build-essential gdb lsb-release time python-irclib wget gnupg ccrypt rsync coreutils sendemail bzr xdelta3 xz-utils unzip openssh-client libio-socket-ssl-perl libnet-ssleay-perl"
+            - "apt-get install -y build-essential gdb lsb-release time wget coreutils bzr xz-utils unzip openssh-client"
+            # LAVA Debugging
+            - apt-get install -y openssh-server
+            # - "apt-get build-dep -y gcc gcc-4.5 gdb eglibc"
+            - "apt-get build-dep -y gcc gcc-4.5"
+            - "cd lava-build-slave/slaves/lava-build"
+            - "./workaround-multiarch.sh"
+run:
+    steps:
+        - "cd lava-build-slave/slaves/lava-build"
+        - "make -f ../../lib/build.mk final/gcc-linaro-4.6-2012.09.stamp"
+
+parse:

=== added file 'slaves/lava-build/init.sh'
--- slaves/lava-build/init.sh	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/init.sh	2013-01-09 16:07:23 +0000
@@ -0,0 +1,7 @@
+#!/bin/sh
+set -x
+
+mkdir -p /tmp/lava
+
+ln -s $PWD/cbuild-gcc* /tmp/lava
+ln -s $PWD/cbuild.img.gz /tmp/lava

=== added file 'slaves/lava-build/local.mk'
--- slaves/lava-build/local.mk	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/local.mk	2013-01-09 16:07:23 +0000
@@ -0,0 +1,5 @@
+TOPDIR=../..
+SCHEDULER_API=http://localhost/dev/null
+PUBLISH_URL=local
+NOTIFY=[e-mail]
+PING_STEP=true

=== added file 'slaves/lava-build/make-build-img.sh'
--- slaves/lava-build/make-build-img.sh	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/make-build-img.sh	2013-01-09 16:07:23 +0000
@@ -0,0 +1,20 @@
+#!/bin/sh
+
+RELEASE='12.02'
+RELEASE_DATE='20120221'
+
+ROOTFS_URL=http://releases.linaro.org/$RELEASE/ubuntu/oneiric-images/nano/linaro-o-nano-tar-$RELEASE_DATE-0.tar.gz
+ROOTFS=$(basename $ROOTFS_URL)
+HWPACK_URL=http://releases.linaro.org/$RELEASE/ubuntu/oneiric-images/nano/hwpack_linaro-lt-panda_$RELEASE_DATE-1_armel_supported.tar.gz
+HWPACK=$(basename $HWPACK_URL)
+
+wget -nc $ROOTFS_URL
+wget -nc $HWPACK_URL
+
+linaro-media-create --hwpack-force-yes --dev panda \
+--image-file cbuild.img \
+--binary $ROOTFS \
+--hwpack $HWPACK \
+--image-size 3G
+
+gzip -9 cbuild.img

=== added file 'slaves/lava-build/workaround-multiarch.sh'
--- slaves/lava-build/workaround-multiarch.sh	1970-01-01 00:00:00 +0000
+++ slaves/lava-build/workaround-multiarch.sh	2013-01-09 16:07:23 +0000
@@ -0,0 +1,15 @@
+#!/bin/bash
+#
+# See https://wiki.linaro.org/MichaelHope/Sandbox/MultiarchWorkarounds
+#
+
+multi=`dpkg-architecture -qDEB_HOST_MULTIARCH`
+
+cd /usr/lib
+ls $multi/*crt*.o | xargs -L 1 ln -sf
+
+cd /usr/include
+for i in asm gnu bits sys; do
+    rm -rf $i
+    ln -sf $multi/$i
+done