Merge lp:~kdub/mir/fix-1220443 into lp:mir

[Kevin DuBois]

fix: lp:1220443

let the test framework to inject stub graphics platforms on the client side during acceptance and integration tests

fix: lp:1220443

let the test framework to inject stub graphics platforms on the client side during acceptance and integration tests

see bug comment for what was happening: https://bugs.launchpad.net/mir/+bug/1220443/comments/3

nb. fix addresses 1220443, but tests-use-real-graphics is still problematic when turned on (https://bugs.launchpad.net/mir/+bug/1221373)

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1056
http://jenkins.qa.ubuntu.com/job/mir-ci/1442/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1947
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1832
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/680/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1442/rebuild

review: Needs Fixing (continuous-integration)

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1057
http://jenkins.qa.ubuntu.com/job/mir-ci/1443/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1948
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1833
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/681/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1443/rebuild

review: Needs Fixing (continuous-integration)

[Daniel van Vugt (vanvugt)]

mir_client_library_debug.h: Incorrect capitalization and punctuation.

mir_connection_factory.h: Incorrect date.

They're not blockers, but should be fixed. I haven't stopped long enough to consider the overall approach however, so abstain for now.

review: Abstain

[Alan Griffiths (alan-griffiths)]

Defining MirConnectionFactory in a private header makes publishing mir_global_connection_factory via the debug API pointless - it is unusable.

Initializing mir_global_connection_factory to point to a default would avoid tests for NULL (should be nullptr).

But a better approach would be to publish a function pointer with the same signature as mir_connect() and have mir_connect() forward to whatever it points at. This pointer should default to a renamed copy of the current implementation.

This would allow clients to intercept the call and optionally call the default implementation (or, in test cases, restore the pointer to use).

review: Needs Fixing

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:1058
http://jenkins.qa.ubuntu.com/job/mir-ci/1457/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1966
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1851
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/695
        deb: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/695/artifact/work/output/*zip*/output.zip

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1457/rebuild

review: Approve (continuous-integration)

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1060
http://jenkins.qa.ubuntu.com/job/mir-ci/1458/
Executed test runs:
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1967/console
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1852/console
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/696/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1458/rebuild

review: Needs Fixing (continuous-integration)

[Daniel van Vugt (vanvugt)]

I'm not sure that exposing the client API as something a client can *modify* is a good idea...

11 +extern MirWaitHandle* (*mir_connect_impl)(
12 + char const *server,
13 + char const *app_name,
14 + mir_connected_callback callback,
15 + void *context);

If nothing else, it's inconsistent to only allow this on one function. Normally you would use LD_PRELOAD (man ld.so) to achieve this.

Also, still... mir_client_library_debug.h: Incorrect capitalization and punctuation.

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:1061
http://jenkins.qa.ubuntu.com/job/mir-ci/1460/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1970
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1855
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/698
        deb: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/698/artifact/work/output/*zip*/output.zip

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1460/rebuild

review: Approve (continuous-integration)

[Alan Griffiths (alan-griffiths)]

> I'm not sure that exposing the client API as something a client can *modify*
> is a good idea...

The key question is: is this needed as part of the debug API, or is it a facility for test code that should be internal to the implementation?

If the former, then we should probably providing a mechanism for intercepting the whole API atomically, not a single functions.

*Needs discussion*

review: Needs Information

[Kevin DuBois (kdub)]

I think its more of a test code facility, so perhaps it should be moved out of the debug header.
Since running with stubbed drivers is the default, I'm not a fan of recommending the use of LD_PRELOAD to anyone who wants to run the android test suite.

[Daniel van Vugt (vanvugt)]

You should be able to do the equivalent of LD_PRELOAD without using the environment variable, maybe? The linker should allow you to, somehow. But I don't have an answer to hand so won't block on it.

Regarding test vs debug code, yeah... Maybe it would be a good idea to not mention the trampoline pointer (mir_connect_impl) in any header at all. Just extern it manually when you need it. That would be better hidden.

[Daniel van Vugt (vanvugt)]

Verified bug 1220443 is fixed.

We can argue over the details later.

review: Approve

[Kevin DuBois (kdub)]

switched to a more hidden extern (was a good idea) so no public-facing headers mention the override. Added a TODO to make a more comprehensive solution to stubbing client functions out

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:1064
http://jenkins.qa.ubuntu.com/job/mir-ci/1470/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/1987
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1872
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/708
        deb: http://jenkins.qa.ubuntu.com/job/mir-saucy-amd64-ci/708/artifact/work/output/*zip*/output.zip

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-ci/1470/rebuild

review: Approve (continuous-integration)

[Alan Griffiths (alan-griffiths)]

I don't like adding implementation to the TestingClientConfiguration interface. The test framework still only uses the exec() function.

Rather than having the tests call functions to change use of connect functions I'd rather see them using an alternative DefaultTestingClientConfiguration/DummyGraphicsTestingClientConfiguration.

I'm not sure that sharing a single TestingServerConfiguration across all tests is a good idea. It shouldn't be a problem (as it is only used in the separate server processes) but it introduces potential for state to leak from one test to another.

review: Needs Fixing

[Robert Carr (robertcarr)]

It looks ok. I think overriding mir_connect is pretty counterintuitive to me though. I wonder if this calls for a 'mir_init' type function which can handle command line arguments, environment, etc, in order to set up client configuration.

[Robert Carr (robertcarr)]

review: Abstain

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1064
No commit message was specified in the merge proposal. Click on the following link and set the commit message (if you want a jenkins rebuild you need to trigger it yourself):
https://code.launchpad.net/~kdub/mir/fix-1220443/+merge/187348/+edit-commit-message

http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/6/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2107
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1992
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/6/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/6/rebuild

review: Needs Fixing (continuous-integration)

[Kevin DuBois (kdub)]

apparently resubmitting a mp resets the commit message...

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1064
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/10/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2111
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1996
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/10/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/10/rebuild

review: Needs Fixing (continuous-integration)

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1067
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/11/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2112
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/1997
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/11/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/11/rebuild

review: Needs Fixing (continuous-integration)

[Alan Griffiths (alan-griffiths)]

58 === added file 'include/test/mir_test_framework/testing_client_configuration.h'
...
97 +struct StubConnectionConfiguration : public mir::client::DefaultConnectionConfiguration
98 +{
99 + StubConnectionConfiguration(std::string const& socket_file);
100 + std::shared_ptr<mir::client::ClientPlatformFactory> the_client_platform_factory() override;
101 +};

An odd file in which to add StubConnectionConfiguration

~~~~

105 + TestingClientConfiguration() {}

Already provided by default

~~~~

106 + virtual ~TestingClientConfiguration() {}

Why allow throwing destructors?

~~~~

335 +DefaultDisplayServerTestFixture::DefaultDisplayServerTestFixture()
336 +{
337 + default_mir_connect_impl = mir_connect_impl;
338 + default_mir_connection_release_impl = mir_connection_release_impl;
339 +
340 + auto options = default_parameters.the_options();
341 + if (!options->get("tests-use-real-graphics", false))
342 + {
343 + mir_connect_impl = mir_connect_test_override;
344 + mir_connection_release_impl = mir_connection_release_override;
345 + }
346 +}

This seems to be happening in the wrong place. The text fixture is created in the test process before forking either the server or the client(s) and therefore this override is applied in all processes.

I'd expect to see this logic invoked* in TestingProcessManager::launch_client_process() - in the path that executes in the client process. (It would then apply equally to the BespokeDisplayServerTestFixture - which, in this MP applies the logic differently for reasons that are not immediately obvious.)

* Adding a virtual bool use_real_graphics() const to TestingClientConfiguration allows the client code to control this by choosing a suitable TestingClientConfiguration implementation instead of the various calls to use_default_connect_functions();

review: Needs Fixing

[Kevin DuBois (kdub)]

@alan, thanks for the review, good ideas. Code looks much cleaner, function pointers are only overwritten in the client's process. Test code can force a certain behavior by overriding use_real_graphics() in the TestingClientConfiguration, but by default, the code will respect the option

[Kevin DuBois (kdub)]

also removed the macro that disabled the tests (except the nested tests)

[==========] 50 tests from 7 test cases ran. (6167 ms total)
[ PASSED ] 50 tests.

  YOU HAVE 4 DISABLED TESTS

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1073
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/25/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2132
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/2017
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/25/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/25/rebuild

review: Needs Fixing (continuous-integration)

[PS Jenkins bot (ps-jenkins)]

FAILED: Continuous integration, rev:1074
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/27/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2134
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/2019
    FAILURE: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/27/console

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/27/rebuild

review: Needs Fixing (continuous-integration)

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:1074
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/28/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2135
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/2020
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/28
        deb: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/28/artifact/work/output/*zip*/output.zip

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/28/rebuild

review: Approve (continuous-integration)

[Alan Griffiths (alan-griffiths)]

778 + process_manager.launch_client_process(config, *server_options);

Probably just the name, but why are we passing *server* options to the client?

review: Needs Fixing

[Kevin DuBois (kdub)]

> 778 + process_manager.launch_client_process(config, *server_options);
>
> Probably just the name, but why are we passing *server* options to the client?

right, they are 'test_case_options', but just most of them happen to apply to the server. Will change

[PS Jenkins bot (ps-jenkins)]

PASSED: Continuous integration, rev:1075
http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-ci/36/
Executed test runs:
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-android-saucy-i386-build/2149
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-clang-saucy-amd64-build/2034
    SUCCESS: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/36
        deb: http://jenkins.qa.ubuntu.com/job/mir-team-mir-development-branch-saucy-amd64-ci/36/artifact/work/output/*zip*/output.zip

Click here to trigger a rebuild:
http://s-jenkins:8080/job/mir-team-mir-development-branch-ci/36/rebuild

review: Approve (continuous-integration)

[Alan Griffiths (alan-griffiths)]

OK

review: Approve

[PS Jenkins bot (ps-jenkins)]

review: Approve (continuous-integration)

=== modified file 'include/test/mir_test_framework/display_server_test_fixture.h'
--- include/test/mir_test_framework/display_server_test_fixture.h	2013-08-28 03:41:48 +0000
+++ include/test/mir_test_framework/display_server_test_fixture.h	2013-09-26 15:08:46 +0000
@@ -46,6 +46,7 @@
 
 private:
     static TestingProcessManager process_manager;
+    static TestingServerConfiguration default_parameters;
 
     virtual void TearDown();
 };
@@ -74,6 +75,7 @@
 
 private:
     TestingProcessManager process_manager;
+    std::shared_ptr<mir::options::Option> test_options;
 };
 
 }

=== added file 'include/test/mir_test_framework/stub_client_connection_configuration.h'
--- include/test/mir_test_framework/stub_client_connection_configuration.h	1970-01-01 00:00:00 +0000
+++ include/test/mir_test_framework/stub_client_connection_configuration.h	2013-09-26 15:08:46 +0000
@@ -0,0 +1,35 @@
+/*
+ * Copyright © 2013 Canonical Ltd.
+ *
+ * This program is free software: you can redistribute it and/or modify it
+ * under the terms of the GNU General Public License version 3,
+ * as published by the Free Software Foundation.
+ *
+ * This program is distributed in the hope that it will be useful,
+ * but WITHOUT ANY WARRANTY; without even the implied warranty of
+ * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+ * GNU General Public License for more details.
+ *
+ * You should have received a copy of the GNU General Public License
+ * along with this program.  If not, see <http://www.gnu.org/licenses/>.
+ *
+ * Authored by: Kevin DuBois <[e-mail]>
+ */
+
+#ifndef MIR_TESTING_STUB_CLIENT_CONNECTION_CONFIGURATION
+#define MIR_TESTING_STUB_CLIENT_CONNECTION_CONFIGURATION
+
+#include "src/client/default_connection_configuration.h"
+#include <memory>
+
+namespace mir_test_framework
+{
+
+struct StubConnectionConfiguration : public mir::client::DefaultConnectionConfiguration
+{
+    StubConnectionConfiguration(std::string const& socket_file);
+    std::shared_ptr<mir::client::ClientPlatformFactory> the_client_platform_factory() override;
+};
+
+}
+#endif /* MIR_TESTING_STUB_CLIENT_CONNECTION_CONFIGURATION */

=== added file 'include/test/mir_test_framework/testing_client_configuration.h'
--- include/test/mir_test_framework/testing_client_configuration.h	1970-01-01 00:00:00 +0000
+++ include/test/mir_test_framework/testing_client_configuration.h	2013-09-26 15:08:46 +0000
@@ -0,0 +1,43 @@
+/*
+ * Copyright © 2013 Canonical Ltd.
+ *
+ * This program is free software: you can redistribute it and/or modify it
+ * under the terms of the GNU General Public License version 3,
+ * as published by the Free Software Foundation.
+ *
+ * This program is distributed in the hope that it will be useful,
+ * but WITHOUT ANY WARRANTY; without even the implied warranty of
+ * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+ * GNU General Public License for more details.
+ *
+ * You should have received a copy of the GNU General Public License
+ * along with this program.  If not, see <http://www.gnu.org/licenses/>.
+ *
+ * Authored by: Kevin DuBois <[e-mail]>
+ */
+
+#ifndef MIR_TESTING_CLIENT_CONFIGURATION
+#define MIR_TESTING_CLIENT_CONFIGURATION
+
+#include "mir/options/option.h"
+
+namespace mir_test_framework
+{
+
+struct TestingClientConfiguration
+{
+    virtual ~TestingClientConfiguration() = default;
+
+    // Code to run in client process
+    virtual void exec() = 0;
+
+    //clients respect the tests-use-real-graphics option by default. use
+    //this function to force the use of the default client configuraiton
+    virtual bool use_real_graphics(mir::options::Option const& options)
+    {
+        return options.get("tests-use-real-graphics", false);
+    } 
+};
+
+}
+#endif /* MIR_TESTING_CLIENT_CONFIGURATION */

=== modified file 'include/test/mir_test_framework/testing_process_manager.h'
--- include/test/mir_test_framework/testing_process_manager.h	2013-08-28 03:41:48 +0000
+++ include/test/mir_test_framework/testing_process_manager.h	2013-09-26 15:08:46 +0000
@@ -24,6 +24,7 @@
 #include "mir_test_framework/process.h"
 
 #include "mir_test_framework/testing_server_configuration.h"
+#include "mir_test_framework/testing_client_configuration.h"
 
 #include <memory>
 #include <list>
@@ -32,19 +33,16 @@
 namespace mir
 {
 class DisplayServer;
+namespace options
+{
+class Option;
+}
 }
 
 namespace mir_test_framework
 {
 using namespace mir;
 
-struct TestingClientConfiguration
-{
-    virtual ~TestingClientConfiguration() = default;
-    // Code to run in client process
-    virtual void exec() = 0;
-};
-
 
 class TestingProcessManager
 {
@@ -53,7 +51,8 @@
     ~TestingProcessManager();
 
     void launch_server_process(TestingServerConfiguration& config);
-    void launch_client_process(TestingClientConfiguration& config);
+    void launch_client_process(TestingClientConfiguration& config,
+                               mir::options::Option const& test_options);
 
     void tear_down_clients();
     void tear_down_server();

=== modified file 'src/client/mir_client_library.cpp'
--- src/client/mir_client_library.cpp	2013-08-28 03:41:48 +0000
+++ src/client/mir_client_library.cpp	2013-09-26 15:08:46 +0000
@@ -77,7 +77,8 @@
 
 }
 
-MirWaitHandle* mir_connect(char const* socket_file, char const* name, mir_connected_callback callback, void * context)
+MirWaitHandle* mir_default_connect(
+    char const* socket_file, char const* name, mir_connected_callback callback, void * context)
 {
 
     try
@@ -93,7 +94,7 @@
             else
                 sock = mir::default_server_socket;
         }
- 
+
         mcl::DefaultConnectionConfiguration conf{sock};
 
         MirConnection* connection = new MirConnection(conf);
@@ -110,6 +111,42 @@
     }
 }
 
+
+void mir_default_connection_release(MirConnection * connection)
+{
+    if (!error_connections.contains(connection))
+    {
+        auto wait_handle = connection->disconnect();
+        wait_handle->wait_for_all();
+    }
+    else
+    {
+        error_connections.remove(connection);
+    }
+
+    delete connection;
+}
+
+//mir_connect and mir_connection_release can be overridden by test code that sets these function
+//pointers to do things like stub out the graphics drivers or change the connection configuration.
+
+//TODO: we could have a more comprehensive solution that allows us to substitute any of the functions
+//for test purposes, not just the connect functions
+MirWaitHandle* (*mir_connect_impl)(
+    char const *server, char const *app_name,
+    mir_connected_callback callback, void *context) = mir_default_connect;
+void (*mir_connection_release_impl) (MirConnection *connection) = mir_default_connection_release;
+
+MirWaitHandle* mir_connect(char const* socket_file, char const* name, mir_connected_callback callback, void * context)
+{
+    return mir_connect_impl(socket_file, name, callback, context);
+}
+
+void mir_connection_release(MirConnection *connection)
+{
+    return mir_connection_release_impl(connection);
+}
+
 MirConnection *mir_connect_sync(char const *server,
                                              char const *app_name)
 {
@@ -131,21 +168,6 @@
     return connection->get_error_message();
 }
 
-void mir_connection_release(MirConnection * connection)
-{
-    if (!error_connections.contains(connection))
-    {
-        auto wait_handle = connection->disconnect();
-        wait_handle->wait_for_all();
-    }
-    else
-    {
-        error_connections.remove(connection);
-    }
-
-    delete connection;
-}
-
 MirEGLNativeDisplayType mir_connection_get_egl_native_display(MirConnection *connection)
 {
     return connection->egl_native_display();

=== modified file 'tests/acceptance-tests/test_client_authorization.cpp'
--- tests/acceptance-tests/test_client_authorization.cpp	2013-08-28 03:41:48 +0000
+++ tests/acceptance-tests/test_client_authorization.cpp	2013-09-26 15:08:46 +0000
@@ -253,6 +253,13 @@
             mir_connection_release(connection);
         }
 
+        //we are testing the connect function itself, without getting to the
+        // point where drivers are used, so force using production config
+        bool use_real_graphics(mir::options::Option const&) override
+        {
+            return true;
+        }
+
         ClientPidTestFixture::SharedRegion* shared_region;
     } client_config(shared_region);
     launch_client_process(client_config);    

=== modified file 'tests/acceptance-tests/test_client_focus_notification.cpp'
--- tests/acceptance-tests/test_client_focus_notification.cpp	2013-09-17 14:31:42 +0000
+++ tests/acceptance-tests/test_client_focus_notification.cpp	2013-09-26 15:08:46 +0000
@@ -30,13 +30,6 @@
 namespace mt = mir::test;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
     char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -147,7 +140,7 @@
 
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(a_surface_is_notified_of_receiving_focus))
+TEST_F(BespokeDisplayServerTestFixture, a_surface_is_notified_of_receiving_focus)
 {
     using namespace ::testing;
 
@@ -176,7 +169,7 @@
 
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(two_surfaces_are_notified_of_gaining_and_losing_focus))
+TEST_F(BespokeDisplayServerTestFixture, two_surfaces_are_notified_of_gaining_and_losing_focus)
 {
     using namespace ::testing;
     

=== modified file 'tests/acceptance-tests/test_client_input.cpp'
--- tests/acceptance-tests/test_client_input.cpp	2013-09-20 15:48:40 +0000
+++ tests/acceptance-tests/test_client_input.cpp	2013-09-26 15:08:46 +0000
@@ -63,13 +63,6 @@
 namespace mtd = mt::doubles;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
     char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -312,7 +305,7 @@
 
 using TestClientInput = BespokeDisplayServerTestFixture;
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(clients_receive_key_input))
+TEST_F(TestClientInput, clients_receive_key_input)
 {
     using namespace ::testing;
     
@@ -358,7 +351,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(clients_receive_us_english_mapped_keys))
+TEST_F(TestClientInput, clients_receive_us_english_mapped_keys)
 {
     using namespace ::testing;
     static std::string const test_client_name = "1";
@@ -404,7 +397,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(clients_receive_motion_inside_window))
+TEST_F(TestClientInput, clients_receive_motion_inside_window)
 {
     using namespace ::testing;
     static std::string const test_client_name = "1";
@@ -453,7 +446,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(clients_receive_button_events_inside_window))
+TEST_F(TestClientInput, clients_receive_button_events_inside_window)
 {
     using namespace ::testing;
     
@@ -534,7 +527,7 @@
 
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(multiple_clients_receive_motion_inside_windows))
+TEST_F(TestClientInput, multiple_clients_receive_motion_inside_windows)
 {
     using namespace ::testing;
     
@@ -646,7 +639,7 @@
     std::vector<geom::Rectangle> const input_rectangles;
 };
 }
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(clients_do_not_receive_motion_outside_input_region))
+TEST_F(TestClientInput, clients_do_not_receive_motion_outside_input_region)
 {
     using namespace ::testing;
     static std::string const test_client_name = "1";
@@ -735,7 +728,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(surfaces_obscure_motion_events_by_stacking))
+TEST_F(TestClientInput, surfaces_obscure_motion_events_by_stacking)
 {
     using namespace ::testing;
     
@@ -853,7 +846,7 @@
 
 }
 
-TEST_F(TestClientInput, DISABLED_ON_ANDROID(hidden_clients_do_not_receive_pointer_events))
+TEST_F(TestClientInput, hidden_clients_do_not_receive_pointer_events)
 {
     using namespace ::testing;
     

=== modified file 'tests/acceptance-tests/test_client_library.cpp'
--- tests/acceptance-tests/test_client_library.cpp	2013-09-24 11:07:53 +0000
+++ tests/acceptance-tests/test_client_library.cpp	2013-09-26 15:08:46 +0000
@@ -42,13 +42,6 @@
 namespace mcl = mir::client;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
     char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -157,7 +150,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(client_library_creates_surface))
+TEST_F(DefaultDisplayServerTestFixture, client_library_creates_surface)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -220,7 +213,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(surface_types))
+TEST_F(DefaultDisplayServerTestFixture, surface_types)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -295,7 +288,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(client_can_set_surface_state))
+TEST_F(DefaultDisplayServerTestFixture, client_can_set_surface_state)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -363,7 +356,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(client_receives_surface_state_events))
+TEST_F(DefaultDisplayServerTestFixture, client_receives_surface_state_events)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -528,13 +521,19 @@
 
             mir_connection_release(connection);
         }
+
+        // this test relies on gbm drivers, use real graphics always
+        bool use_real_graphics(mir::options::Option const&) override
+        {
+            return true;
+        }
     } client_config;
 
     launch_client_process(client_config);
 }
 #endif
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(client_library_creates_multiple_surfaces))
+TEST_F(DefaultDisplayServerTestFixture, client_library_creates_multiple_surfaces)
 {
     int const n_surfaces = 13;
 
@@ -612,7 +611,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(client_library_accesses_and_advances_buffers))
+TEST_F(DefaultDisplayServerTestFixture, client_library_accesses_and_advances_buffers)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -652,7 +651,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(fully_synchronous_client))
+TEST_F(DefaultDisplayServerTestFixture, fully_synchronous_client)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -694,7 +693,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(highly_threaded_client))
+TEST_F(DefaultDisplayServerTestFixture, highly_threaded_client)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -838,6 +837,13 @@
                 FAIL() << error;
             }
         }
+
+        //we are testing the connect function itself, without getting to the
+        // point where drivers are used, so force using production config
+        bool use_real_graphics(mir::options::Option const&) override
+        {
+            return true;
+        }
     } client_config;
 
     launch_client_process(client_config);
@@ -867,6 +873,13 @@
 
             mir_connection_release(connection);
         }
+
+        //we are testing the connect function itself, without getting to the
+        // point where drivers are used, so force using production config
+        bool use_real_graphics(mir::options::Option const&) override
+        {
+            return true;
+        }
     } client_config;
 
     launch_client_process(client_config);
@@ -878,7 +891,7 @@
     signalled = true;
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(ClientLibraryThreadsHandleNoSignals))
+TEST_F(DefaultDisplayServerTestFixture, ClientLibraryThreadsHandleNoSignals)
 {
     struct ClientConfig : ClientConfigCommon
     {
@@ -961,7 +974,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(MultiSurfaceClientTracksBufferFdsCorrectly))
+TEST_F(DefaultDisplayServerTestFixture, MultiSurfaceClientTracksBufferFdsCorrectly)
 {
     struct ClientConfig : ClientConfigCommon
     {

=== modified file 'tests/acceptance-tests/test_focus_selection.cpp'
--- tests/acceptance-tests/test_focus_selection.cpp	2013-09-17 14:31:42 +0000
+++ tests/acceptance-tests/test_focus_selection.cpp	2013-09-26 15:08:46 +0000
@@ -41,13 +41,6 @@
 namespace mt = mir::test;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
     char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -134,7 +127,7 @@
 }
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(sessions_creating_surface_receive_focus))
+TEST_F(BespokeDisplayServerTestFixture, sessions_creating_surface_receive_focus)
 {
     struct ServerConfig : TestingServerConfiguration
     {
@@ -168,7 +161,7 @@
     launch_client_process(client);
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(surfaces_receive_input_focus_when_created))
+TEST_F(BespokeDisplayServerTestFixture, surfaces_receive_input_focus_when_created)
 {
     struct ServerConfig : TestingServerConfiguration
     {

=== modified file 'tests/acceptance-tests/test_server_shutdown.cpp'
--- tests/acceptance-tests/test_server_shutdown.cpp	2013-09-24 11:43:27 +0000
+++ tests/acceptance-tests/test_server_shutdown.cpp	2013-09-26 15:08:46 +0000
@@ -39,13 +39,6 @@
 namespace ms = mir::surfaces;
 namespace geom = mir::geometry;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
 
@@ -119,7 +112,7 @@
 
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(server_can_shut_down_when_clients_are_blocked))
+TEST_F(BespokeDisplayServerTestFixture, server_can_shut_down_when_clients_are_blocked)
 {
     Flag next_buffer_done1{"next_buffer_done1_c5d49978.tmp"};
     Flag next_buffer_done2{"next_buffer_done2_c5d49978.tmp"};
@@ -206,7 +199,7 @@
     });
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(server_releases_resources_on_shutdown_with_connected_clients))
+TEST_F(BespokeDisplayServerTestFixture, server_releases_resources_on_shutdown_with_connected_clients)
 {
     Flag surface_created1{"surface_created1_7e9c69fc.tmp"};
     Flag surface_created2{"surface_created2_7e9c69fc.tmp"};

=== modified file 'tests/acceptance-tests/test_shell_control_of_surface_configuration.cpp'
--- tests/acceptance-tests/test_shell_control_of_surface_configuration.cpp	2013-09-17 14:31:42 +0000
+++ tests/acceptance-tests/test_shell_control_of_surface_configuration.cpp	2013-09-26 15:08:46 +0000
@@ -34,13 +34,6 @@
 namespace mtd = mt::doubles;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
     char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -77,7 +70,7 @@
 
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(the_shell_surface_configurator_is_notified_of_attribute_changes))
+TEST_F(BespokeDisplayServerTestFixture, the_shell_surface_configurator_is_notified_of_attribute_changes)
 {
     struct ServerConfiguration : TestingServerConfiguration
     {
@@ -116,7 +109,7 @@
     launch_client_process(client_config);
 }
 
-TEST_F(BespokeDisplayServerTestFixture, DISABLED_ON_ANDROID(the_shell_surface_configurator_may_interfere_with_attribute_changes))
+TEST_F(BespokeDisplayServerTestFixture, the_shell_surface_configurator_may_interfere_with_attribute_changes)
 {
     struct ServerConfiguration : TestingServerConfiguration
     {

=== modified file 'tests/acceptance-tests/test_surfaceloop.cpp'
--- tests/acceptance-tests/test_surfaceloop.cpp	2013-09-17 14:31:42 +0000
+++ tests/acceptance-tests/test_surfaceloop.cpp	2013-09-26 15:08:46 +0000
@@ -36,13 +36,6 @@
 namespace mcl = mir::client;
 namespace mtf = mir_test_framework;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
 char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -161,7 +154,7 @@
 }
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(creates_surface_of_correct_size))
+TEST_F(DefaultDisplayServerTestFixture, creates_surface_of_correct_size)
 {
     struct Client : ClientConfigCommon
     {
@@ -215,7 +208,7 @@
     launch_client_process(client_creates_surfaces);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(surfaces_have_distinct_ids))
+TEST_F(DefaultDisplayServerTestFixture, surfaces_have_distinct_ids)
 {
     struct Client : ClientConfigCommon
     {
@@ -260,7 +253,7 @@
     launch_client_process(client_creates_surfaces);
 }
 
-TEST_F(DefaultDisplayServerTestFixture, DISABLED_ON_ANDROID(creates_multiple_surfaces_async))
+TEST_F(DefaultDisplayServerTestFixture, creates_multiple_surfaces_async)
 {
     struct Client : ClientConfigCommon
     {

=== modified file 'tests/acceptance-tests/test_surfaces_with_output_id.cpp'
--- tests/acceptance-tests/test_surfaces_with_output_id.cpp	2013-09-17 14:31:42 +0000
+++ tests/acceptance-tests/test_surfaces_with_output_id.cpp	2013-09-26 15:08:46 +0000
@@ -43,13 +43,6 @@
 namespace mg = mir::graphics;
 namespace mtd = mir::test::doubles;
 
-// TODO resolve problems running tests on android
-#ifdef ANDROID
-#define DISABLED_ON_ANDROID(name) DISABLED_##name
-#else
-#define DISABLED_ON_ANDROID(name) name
-#endif
-
 namespace
 {
 char const* const mir_test_socket = mtf::test_socket_file().c_str();
@@ -128,7 +121,7 @@
 
 using SurfacesWithOutputId = BespokeDisplayServerTestFixture;
 
-TEST_F(SurfacesWithOutputId, DISABLED_ON_ANDROID(fullscreen_surfaces_are_placed_at_top_left_of_correct_output))
+TEST_F(SurfacesWithOutputId, fullscreen_surfaces_are_placed_at_top_left_of_correct_output)
 {
     mt::CrossProcessAction client_connect_and_create_surface;
     mt::CrossProcessAction client_release_surface_and_disconnect;
@@ -266,7 +259,7 @@
     });
 }
 
-TEST_F(SurfacesWithOutputId, DISABLED_ON_ANDROID(non_fullscreen_surfaces_are_not_accepted))
+TEST_F(SurfacesWithOutputId, non_fullscreen_surfaces_are_not_accepted)
 {
     mt::CrossProcessAction client_connect_and_create_surfaces;
     mt::CrossProcessAction client_disconnect;

=== modified file 'tests/mir_test_framework/CMakeLists.txt'
--- tests/mir_test_framework/CMakeLists.txt	2013-08-28 03:41:48 +0000
+++ tests/mir_test_framework/CMakeLists.txt	2013-09-26 15:08:46 +0000
@@ -13,6 +13,7 @@
   testing_server_options.cpp
   input_testing_server_options.cpp
   testing_process_manager.cpp
+  testing_client_options.cpp
   display_server_test_fixture.cpp
   process.cpp
 )

=== modified file 'tests/mir_test_framework/display_server_test_fixture.cpp'
--- tests/mir_test_framework/display_server_test_fixture.cpp	2013-08-28 03:41:48 +0000
+++ tests/mir_test_framework/display_server_test_fixture.cpp	2013-09-26 15:08:46 +0000
@@ -17,20 +17,22 @@
  */
 
 #include "mir_test_framework/display_server_test_fixture.h"
+#include "mir_test_framework/testing_client_configuration.h"
+#include "src/client/mir_connection.h"
 
 namespace mc = mir::compositor;
-
-mir_test_framework::TestingProcessManager mir_test_framework::DefaultDisplayServerTestFixture::process_manager;
-
+namespace mtf = mir_test_framework;
+
+mtf::TestingProcessManager mir_test_framework::DefaultDisplayServerTestFixture::process_manager;
+mtf::TestingServerConfiguration mir_test_framework::DefaultDisplayServerTestFixture::default_parameters;
 
 void DefaultDisplayServerTestFixture::launch_client_process(TestingClientConfiguration& config)
 {
-    process_manager.launch_client_process(config);
+    process_manager.launch_client_process(config, *default_parameters.the_options());
 }
 
 void DefaultDisplayServerTestFixture::SetUpTestCase()
 {
-    TestingServerConfiguration default_parameters;
     process_manager.launch_server_process(default_parameters);
 }
 
@@ -54,12 +56,13 @@
 
 void BespokeDisplayServerTestFixture::launch_server_process(TestingServerConfiguration& functor)
 {
+    test_options = functor.the_options();
     process_manager.launch_server_process(functor);
 }
 
 void BespokeDisplayServerTestFixture::launch_client_process(TestingClientConfiguration& config)
 {
-    process_manager.launch_client_process(config);
+    process_manager.launch_client_process(config, *test_options);
 }
 
 bool BespokeDisplayServerTestFixture::shutdown_server_process()

=== added file 'tests/mir_test_framework/testing_client_options.cpp'
--- tests/mir_test_framework/testing_client_options.cpp	1970-01-01 00:00:00 +0000
+++ tests/mir_test_framework/testing_client_options.cpp	2013-09-26 15:08:46 +0000
@@ -0,0 +1,126 @@
+/*
+ * Copyright © 2013 Canonical Ltd.
+ *
+ * This program is free software: you can redistribute it and/or modify it
+ * under the terms of the GNU General Public License version 3,
+ * as published by the Free Software Foundation.
+ *
+ * This program is distributed in the hope that it will be useful,
+ * but WITHOUT ANY WARRANTY; without even the implied warranty of
+ * MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+ * GNU General Public License for more details.
+ *
+ * You should have received a copy of the GNU General Public License
+ * along with this program.  If not, see <http://www.gnu.org/licenses/>.
+ *
+ * Authored by: Kevin DuBois <[e-mail]>
+ */
+
+#include "mir_test_framework/testing_client_configuration.h"
+#include "mir_test_framework/stub_client_connection_configuration.h"
+#include "mir/options/program_option.h"
+#include "src/client/default_connection_configuration.h"
+#include "src/client/client_platform_factory.h"
+#include "src/client/client_buffer_factory.h"
+#include "src/client/client_buffer.h"
+#include "src/client/client_platform.h"
+#include "src/client/mir_connection.h"
+
+namespace mcl = mir::client;
+namespace mtf=mir_test_framework;
+namespace geom = mir::geometry;
+
+
+namespace
+{
+class StubClientBuffer : public mcl::ClientBuffer
+{
+    std::shared_ptr<mcl::MemoryRegion> secure_for_cpu_write()
+    {
+        return nullptr;
+    }
+
+    geom::Size size() const
+    {
+        return geom::Size{};
+    }
+
+    geom::Stride stride() const
+    {
+        return geom::Stride{};
+    }
+
+    geom::PixelFormat pixel_format() const
+    {
+        return geom::PixelFormat::abgr_8888;
+    }
+    
+    uint32_t age() const
+    {
+        return 0;
+    }
+    void increment_age()
+    {
+    }
+    void mark_as_submitted()
+    {
+    }
+    std::shared_ptr<MirNativeBuffer> native_buffer_handle() const
+    {
+        return nullptr;
+    }
+};
+
+struct StubClientBufferFactory : public mcl::ClientBufferFactory
+{
+    std::shared_ptr<mcl::ClientBuffer> create_buffer(std::shared_ptr<MirBufferPackage> const&,
+                                                     geom::Size, geom::PixelFormat)
+    {
+        return std::make_shared<StubClientBuffer>();
+    }
+};
+
+struct StubClientPlatform : public mcl::ClientPlatform
+{
+    MirPlatformType platform_type() const
+    {
+        return mir_platform_type_gbm;
+    }
+
+    std::shared_ptr<mcl::ClientBufferFactory> create_buffer_factory()
+    {
+        return std::make_shared<StubClientBufferFactory>();
+    }
+
+    std::shared_ptr<EGLNativeWindowType> create_egl_native_window(mcl::ClientSurface*)
+    {
+        auto fake_window = reinterpret_cast<EGLNativeWindowType>(0x12345678);
+        return std::make_shared<EGLNativeWindowType>(fake_window);
+    }
+
+    std::shared_ptr<EGLNativeDisplayType> create_egl_native_display()
+    {
+        auto fake_display = reinterpret_cast<EGLNativeDisplayType>(0x12345678);
+        return std::make_shared<EGLNativeDisplayType>(fake_display);
+    }
+};
+
+struct StubClientPlatformFactory : public mcl::ClientPlatformFactory
+{
+    std::shared_ptr<mcl::ClientPlatform> create_client_platform(mcl::ClientContext*)
+    {
+        return std::make_shared<StubClientPlatform>();
+    }
+};
+
+}
+
+mtf::StubConnectionConfiguration::StubConnectionConfiguration(std::string const& socket_file)
+    : DefaultConnectionConfiguration(socket_file)
+{
+}
+
+std::shared_ptr<mcl::ClientPlatformFactory> mtf::StubConnectionConfiguration::the_client_platform_factory()
+{
+    return std::make_shared<StubClientPlatformFactory>();
+}

=== modified file 'tests/mir_test_framework/testing_process_manager.cpp'
--- tests/mir_test_framework/testing_process_manager.cpp	2013-09-19 18:18:35 +0000
+++ tests/mir_test_framework/testing_process_manager.cpp	2013-09-26 15:08:46 +0000
@@ -16,8 +16,11 @@
  * Authored by: Alan Griffiths <[e-mail]>
  */
 
+#include "mir_toolkit/client_types.h"
 #include "mir_test_framework/testing_process_manager.h"
 #include "mir_test_framework/detect_server.h"
+#include "mir_test_framework/stub_client_connection_configuration.h"
+#include "src/client/mir_connection.h"
 #include "mir/run_mir.h"
 
 #include <gmock/gmock.h>
@@ -25,6 +28,7 @@
 #include <thread>
 #include <stdexcept>
 
+namespace mo = mir::options;
 namespace mc = mir::compositor;
 namespace mtf = mir_test_framework;
 
@@ -76,7 +80,38 @@
     }
 }
 
-void mtf::TestingProcessManager::launch_client_process(TestingClientConfiguration& config)
+/* if set before any calls to the api functions, assigning to this pointer will allow user to
+ * override calls to mir_connect() and mir_connection_release(). This is mostly useful in test scenarios
+ */
+extern MirWaitHandle* (*mir_connect_impl)(
+    char const *server,
+    char const *app_name,
+    mir_connected_callback callback,
+    void *context);
+extern void (*mir_connection_release_impl) (MirConnection *connection);
+
+namespace
+{
+MirWaitHandle* mir_connect_test_override(
+    char const *socket_file,
+    char const *app_name,
+    mir_connected_callback callback,
+    void *context)
+{
+    mtf::StubConnectionConfiguration conf(socket_file);
+    auto connection = new MirConnection(conf);
+    return connection->connect(app_name, callback, context);
+}
+
+void mir_connection_release_override(MirConnection *connection)
+{
+    auto wait_handle = connection->disconnect();
+    wait_handle->wait_for_all();
+    delete connection;
+}
+}
+
+void mtf::TestingProcessManager::launch_client_process(TestingClientConfiguration& config, mo::Option const& test_options)
 {
     if (!is_test_process)
     {
@@ -108,6 +143,11 @@
         server_process.reset();
 
         SCOPED_TRACE("Client");
+        if (!config.use_real_graphics(test_options))
+        {
+            mir_connect_impl = mir_connect_test_override;
+            mir_connection_release_impl = mir_connection_release_override;
+        }
         config.exec();
         exit(::testing::Test::HasFailure() ? EXIT_FAILURE : EXIT_SUCCESS);
     }