rclone-dev:fix-ks3

Last commit made on 2020-10-26
Get this branch:
git clone -b fix-ks3 https://git.launchpad.net/rclone-dev

Branch merges

Branch information

Name:
fix-ks3
Repository:
lp:rclone-dev

Recent commits

2f0ef2e... by Nick Craig-Wood

s3: fix v2 auth for multipart server side copy

Before this change the v2 signer sorted the headers for signing as
joined key:value pairs. However this put these two headers in the
wrong order.

    x-amz-copy-source-range:
    x-amz-copy-source:

This changes sorts on the keys before joining the values producing the
correct sort order.

    x-amz-copy-source:
    x-amz-copy-source-range:

This commit also adds some missing query parameters for signing that I
spotted in the s3cmd source.

a8db0be... by Nick Craig-Wood

s3: fix KS3 problem where multipart uploads have valid md5sums as Etags

KS3 appears to return an Etag which is a valid MD5SUM for multipart
uploads. This confuses rclone which is expecting an invalid MD5SUM
here.

This patch works around that by clearing the Etag on the object
returned from a multipart upload if it matches a valid MD5SUM.

c85438d... by Nick Craig-Wood

s3: fix v2 auth when using force_path_style = false

The V2 auth was failing with AWS and KS3 when used with
force_path_style = false (which is the default for both providers
now).

The V2 Auth needed the bucket prepended onto the string that gets
signed.

Note that endpoint must be set when using v2 auth with AWS. The code
warns about this.

This was worked out by observing the behaviour of s3cmd.

a2fa137... by Nick Craig-Wood

build: work around GitHub actions brew problem

Brew was failing with

    fatal: 'origin' does not appear to be a git repository
    fatal: Could not read from remote repository.

See: https://github.com/actions/virtual-environments/issues/1811
See: https://github.com/actions/virtual-environments/issues/1869

bed83b0... by Nick Craig-Wood

test: add ListRetries config parameter to integration tests

Occasionally the b2 tests fail because the integration tests don't
retry hard enough with their new setting of -list-retries 3. Override
this setting to 5 for the b2 tests only.

cf0bdad... by Nick Craig-Wood

union: create root directories if none exist

This fixes the TestUnion: integration test if the /tmp/union[123] dirs
don't exist.

85d35ef... by Nick Craig-Wood

test: remove TestS3Ceph: and TestSwiftCeph: from integration tests

Unfortunately we don't have access to this server any more

514d10b... by Nick Craig-Wood

Add Ingo to contributors

5164c3d... by LaSombra

genautocomplete: add support to output to stdout

ffdd071... by albertony <email address hidden>

jottacloud: avoid double url escaping of device/mountpoint - fixes #4697