Merge lp:~albaguirre/unity-mir/add-cross-compile-scripts into lp:unity-mir

[Alberto Aguirre]

Add dev scripts to support cross-compilation

Adapted cross compile scripts from mir project to support cross compilation
using a basic armhf chroot environment populated using debootstrap - the build dependencies are parsed from debian/control

These scripts are intended for development purposes only

Add dev scripts to support cross-compilation

Adapted cross compile scripts from mir project to support cross compilation
using a basic armhf chroot environment populated using debootstrap - the build dependencies are parsed from debian/control

These scripts are intended for development purposes only

[Andreas Pokorny (andreas-pokorny)]

worked for me

review: Approve

[Andreas Pokorny (andreas-pokorny)]

one strange nit .. after running it once, then changing the CMAKE_BUILD_TYPE and INSTALL_PREFIX it forgot the which moc to use. So I had to add to the environment again - Then after the second run it CMake no longer cared bout the env - maybe it needs two runs to settle in the first place.

In the end that information should be fixed for the build when written to Builddir/...../AutomocInfo.cmake ...

Will try again in a bit.

review: Abstain

[Andreas Pokorny (andreas-pokorny)]

found no clean solution - those env variable need to be set during build

review: Approve

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:176
http://jenkins.qa.ubuntu.com/job/unity-mir-ci/251/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-amd64-ci/114
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/115
        deb: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/115/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-i386-ci/114

Click here to trigger a rebuild:
http://s-jenkins.ubuntu-ci:8080/job/unity-mir-ci/251/rebuild

review: Approve (continuous-integration)

[lp:~albaguirre/unity-mir/add-cross-compile-scripts]

179. By Daniel d'Andrada on 2014-02-14

Unity8 now provides a clipboard service through the mir socket

That service can later be used for other custom messages as well.

180. By PS Jenkins bot on 2014-02-14

Releasing 0.2+14.04.20140214-0ubuntu1

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:177
http://jenkins.qa.ubuntu.com/job/unity-mir-ci/255/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-amd64-ci/118
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/119
        deb: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/119/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-i386-ci/118

Click here to trigger a rebuild:
http://s-jenkins.ubuntu-ci:8080/job/unity-mir-ci/255/rebuild

review: Approve (continuous-integration)

[lp:~albaguirre/unity-mir/add-cross-compile-scripts]

181. By Alberto Aguirre on 2014-02-21

[cmake] Use XXX_LDFLAGS for libraries found with pkg_check_modules.

Using the pkg given LDFLAGS resolves linking issues when cross-compiling

182. By Alberto Aguirre on 2014-02-21

Add dev scripts to support cross-compilation

These scripts are adapted from the mir project.
The build dependencies are parsed from debian/control and
given to debootstrap to setup a basic armhf chroot environment for cross-compilation.

These scripts are intended for development purposes only

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:182
http://jenkins.qa.ubuntu.com/job/unity-mir-ci/263/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-amd64-ci/126
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/127
        deb: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-armhf-ci/127/artifact/work/output/*zip*/output.zip
    SUCCESS: http://jenkins.qa.ubuntu.com/job/unity-mir-trusty-i386-ci/126

Click here to trigger a rebuild:
http://s-jenkins.ubuntu-ci:8080/job/unity-mir-ci/263/rebuild

review: Approve (continuous-integration)

[Gerry Boland (gerboland)]

Works nice, thanks! I've been trying using sbuild with chroot to cross build packages, but I've never managed to get it working it (based on https://wiki.ubuntu.com/SimpleSbuild), so this will do nicely in the interim.

review: Approve

=== added directory 'cmake'
=== added file 'cmake/LinuxCrossCompile.cmake'
--- cmake/LinuxCrossCompile.cmake	1970-01-01 00:00:00 +0000
+++ cmake/LinuxCrossCompile.cmake	2014-02-21 21:56:07 +0000
@@ -0,0 +1,39 @@
+set(CMAKE_SYSTEM_NAME Linux)
+set(CMAKE_SYSTEM_VERSION 1)
+
+set(UNITYMIR_CHROOT_DIR $ENV{UNITYMIR_CHROOT_DIR} CACHE STRING "directory containing partial chroot for unity-mir cross-compilation")
+set(UNITYMIR_ARM_EABI "arm-linux-gnueabihf")
+
+set(CMAKE_C_COMPILER   /usr/bin/${UNITYMIR_ARM_EABI}-gcc)
+set(CMAKE_CXX_COMPILER /usr/bin/${UNITYMIR_ARM_EABI}-g++)
+
+# where to look to find dependencies in the target environment
+set(CMAKE_FIND_ROOT_PATH  "${UNITYMIR_CHROOT_DIR}")
+
+#treat the chroot's includes as system includes
+include_directories(SYSTEM "${UNITYMIR_CHROOT_DIR}/usr/include" "${UNITYMIR_CHROOT_DIR}/usr/include/${UNITYMIR_ARM_EABI}")
+
+list(APPEND CMAKE_SYSTEM_INCLUDE_PATH "${UNITYMIR_CHROOT_DIR}/usr/include" "${UNITYMIR_CHROOT_DIR}/usr/include/${UNITYMIR_ARM_EABI}" )
+
+# Add the chroot libraries as system libraries
+list(APPEND CMAKE_SYSTEM_LIBRARY_PATH
+  "${UNITYMIR_CHROOT_DIR}/lib"
+  "${UNITYMIR_CHROOT_DIR}/lib/${UNITYMIR_ARM_EABI}"
+  "${UNITYMIR_CHROOT_DIR}/usr/lib"
+  "${UNITYMIR_CHROOT_DIR}/usr/lib/${UNITYMIR_ARM_EABI}"
+)
+
+set(CMAKE_INSTALL_RPATH_USE_LINK_PATH FALSE)
+set(CMAKE_BUILD_WITH_INSTALL_RPATH TRUE)
+set(CMAKE_EXECUTABLE_RUNTIME_C_FLAG "-Wl,-rpath-link,")
+set(CMAKE_EXECUTABLE_RUNTIME_CXX_FLAG "-Wl,-rpath-link,")
+set(CMAKE_INSTALL_RPATH "${UNITYMIR_CHROOT_DIR}/lib:${UNITYMIR_CHROOT_DIR}/lib/${UNITYMIR_ARM_EABI}:${UNITYMIR_CHROOT_DIR}/usr/lib:${UNITYMIR_CHROOT_DIR}/usr/lib/${UNITYMIR_ARM_EABI}:${UNITYMIR_CHROOT_DIR}/usr/lib/${UNITYMIR_ARM_EABI}/mesa-egl")
+
+set(ENV{PKG_CONFIG_PATH} "${UNITYMIR_CHROOT_DIR}/usr/lib/pkgconfig:${UNITYMIR_CHROOT_DIR}/usr/lib/${UNITYMIR_ARM_EABI}/pkgconfig")
+set(ENV{PKG_CONFIG_SYSROOT_DIR} "${UNITYMIR_CHROOT_DIR}")
+
+#use only the cross compile system
+set(CMAKE_FIND_ROOT_PATH_MODE_PROGRAM NEVER)
+set(CMAKE_FIND_ROOT_PATH_MODE_LIBRARY ONLY)
+set(CMAKE_FIND_ROOT_PATH_MODE_INCLUDE ONLY)
+

=== added file 'cross-compile.sh'
--- cross-compile.sh	1970-01-01 00:00:00 +0000
+++ cross-compile.sh	2014-02-21 21:56:07 +0000
@@ -0,0 +1,85 @@
+#!/bin/bash
+# build script to compile unity-mir for armhf devices
+
+set -e
+
+usage() {
+  echo "usage: $(basename $0) [-c] [-u]"
+  echo "-c clean before building"
+  echo "-u update partial chroot directory"
+  echo "-h this message"
+}
+
+clean_build_dir() {
+    rm -rf ${1}
+    mkdir ${1}
+}
+
+BUILD_DIR=build-android-arm
+NUM_JOBS=$(( $(grep -c ^processor /proc/cpuinfo) + 1 ))
+_do_update_chroot=0
+
+while getopts "cuh" OPTNAME
+do
+    case $OPTNAME in
+      c )
+        clean_build_dir ${BUILD_DIR}
+        ;;
+      u )
+        _do_update_chroot=1
+        ;;
+      h )
+        usage
+        exit 0
+        ;;
+      * )
+        echo "invalid option specified"
+        usage
+        exit 1
+        ;;
+    esac
+done
+
+
+if [ "${UNITYMIR_CHROOT_DIR}" = "" ]; then
+    export UNITYMIR_CHROOT_DIR=$(pwd)/partial-armhf-chroot
+fi
+
+if [ ! -d ${UNITYMIR_CHROOT_DIR} ]; then 
+    echo "no partial chroot dir detected. attempting to create one"
+    _do_update_chroot=1
+fi
+
+if [ ! -d ${BUILD_DIR} ]; then 
+    mkdir ${BUILD_DIR}
+fi
+
+if [ ${_do_update_chroot} -eq 1 ] ; then
+    pushd scripts > /dev/null
+        ./setup-partial-armhf-chroot.sh ${UNITYMIR_CHROOT_DIR}
+    popd > /dev/null
+    # force a clean build after an update, since CMake cache maybe out of date
+    clean_build_dir ${BUILD_DIR}
+fi
+
+echo "Using UNITYMIR_CHROOT_DIR: ${UNITYMIR_CHROOT_DIR}"
+
+pushd ${BUILD_DIR} > /dev/null 
+
+    export CMAKE_PREFIX_PATH=${UNITYMIR_CHROOT_DIR}/usr/lib/arm-linux-gnueabihf/cmake
+    export PKG_CONFIG_PATH="${UNITYMIR_CHROOT_DIR}/usr/lib/pkgconfig:${UNITYMIR_CHROOT_DIR}/usr/lib/arm-linux-gnueabihf/pkgconfig"
+    export PKG_CONFIG_ALLOW_SYSTEM_CFLAGS=1
+    export PKG_CONFIG_ALLOW_SYSTEM_LIBS=1
+    export PKG_CONFIG_SYSROOT_DIR=${UNITYMIR_CHROOT_DIR}
+    export PKG_CONFIG_EXECUTABLE=`which pkg-config`
+    echo "Using PKG_CONFIG_PATH: $PKG_CONFIG_PATH"
+    echo "Using PKG_CONFIG_EXECUTABLE: $PKG_CONFIG_EXECUTABLE"
+    
+    # These are used to make cmake select the host machine QT MOC compiler in the AutoMocInfo module
+    export DEB_HOST_MULTIARCH=arm-linux-gnueabihf
+    export DEB_BUILD_MULTIARCH=$(gcc -dumpmachine)
+
+    cmake -DCMAKE_TOOLCHAIN_FILE=../cmake/LinuxCrossCompile.cmake ..
+    make -j${NUM_JOBS}
+
+popd ${BUILD_DIR} > /dev/null 

=== added directory 'scripts'
=== added file 'scripts/fix-qt-cmake.sh'
--- scripts/fix-qt-cmake.sh	1970-01-01 00:00:00 +0000
+++ scripts/fix-qt-cmake.sh	2014-02-21 21:56:07 +0000
@@ -0,0 +1,10 @@
+#!/bin/bash
+
+# $1 must contain path to QT cmake files
+# Given that path, all hardcoded root paths are fixed up
+for file in $(find ${1} -type f -name \*.cmake)
+do
+    echo "fixing $file"
+    sed -i 's/NO_DEFAULT_PATH/ONLY_CMAKE_FIND_ROOT_PATH/g' $file
+    sed -i 's/\/usr/${CMAKE_FIND_ROOT_PATH}\/usr/g' $file
+done

=== added file 'scripts/setup-partial-armhf-chroot.sh'
--- scripts/setup-partial-armhf-chroot.sh	1970-01-01 00:00:00 +0000
+++ scripts/setup-partial-armhf-chroot.sh	2014-02-21 21:56:07 +0000
@@ -0,0 +1,67 @@
+#!/bin/bash
+
+set -e
+
+if [ -z ${1} ]; then
+    echo "please supply directory to create partial chroot in. (eg, ./setup-partial-armhf-chroot.sh mychroot-dir)"
+    exit
+fi
+
+echo "creating phablet-compatible armhf partial chroot for unity-mir compilation in directory ${1}"
+
+if [ ! -d ${1} ]; then
+    mkdir -p ${1} 
+fi
+
+DEBCONTROL=$(pwd)/../debian/control
+
+pushd ${1} > /dev/null
+
+# Empty dpkg status file, so that ALL dependencies are listed with dpkg-checkbuilddeps
+echo "" > status
+
+# Manual error code checking is needed for dpkg-checkbuilddeps
+set +e
+
+# Parse dependencies from debian/control
+# dpkg-checkbuilddeps returns 1 when dependencies are not met and the list is sent to stderr
+builddeps=$(dpkg-checkbuilddeps -a armhf --admindir=. ${DEBCONTROL} 2>&1 )
+if [ $? -ne 1 ] ; then
+    echo "${builddeps}"
+    exit 2
+fi
+
+# now turn exit on error option
+set -e
+
+# Sanitize dependencies list for submission to debootstrap
+# build-essential is not needed as we are cross-compiling
+builddeps=$(echo ${builddeps} | sed -e 's/dpkg-checkbuilddeps://g' -e 's/Unmet build dependencies://g' -e 's/build-essential:native//g')
+builddeps=$(echo ${builddeps} | sed 's/([^)]*)//g')
+# TODO: figure out why debootstrap is not finding libunity-api-dev package - it doesn't seem to be needed for cross-compilation - is it needed in debian/control?
+builddeps=$(echo ${builddeps} | sed 's/libunity-api-dev//g')
+builddeps=$(echo ${builddeps} | sed 's/ /,/g')
+
+fakeroot debootstrap --include=${builddeps} --arch=armhf --download-only --variant=buildd trusty .
+
+# Remove libc libraries that confuse the cross-compiler
+rm var/cache/apt/archives/libc-dev*.deb
+rm var/cache/apt/archives/libc6*.deb
+
+for deb in var/cache/apt/archives/* ; do
+if [ ! -d ${deb} ] ; then
+    echo "unpacking: ${deb}"
+    dpkg -x ${deb} .
+fi
+done
+
+# Fix up symlinks which asssumed the usual root path
+for broken_symlink in $(find . -name \*.so -type l -xtype l) ; do
+    ln -sf $(pwd)$(readlink ${broken_symlink}) ${broken_symlink}
+done
+
+popd > /dev/null
+
+# QT CMake files have hardcoded root paths - fix them up
+./fix-qt-cmake.sh ${1}/usr/lib/arm-linux-gnueabihf/cmake/
+