I am experiencing the same problem and I've found it is triggered by the --progress flag.
The following demonstrates the problem:
location=~/duplicity-test
mkdir -p "$location"/{.cache,src,dst}
mkdir -p "$location"/src/{dir1,dir2}/{subdir1,subdir2}
find "$location/src" -type d -exec touch {}/testfile \;
echo "- $location/src/dir2/subdir2" > "$location/exclude"
duplicity --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist "$location/exclude" "$location/src" file://"$location/dst"
Using archive dir: /home/scott/duplicity-test/.cache/test_backup
Using backup name: test_backup
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.copycombackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Reading globbing filelist /home/scott/duplicity-test/exclude
Main action: inc
================================================================================
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --archive-dir /home/scott/duplicity-test/.cache --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist /home/scott/duplicity-test/exclude /home/scott/duplicity-test/src file:///home/scott/duplicity-test/dst
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
================================================================================
Using temporary directory /tmp/duplicity-gzjWQ7-tempdir
Temp has 35840032768 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: none
No signatures found, switching to full backup.
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-xqRenW-tempdir
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-y6w8cZ-tempdir
AsyncScheduler: instantiating at concurrency 0
A .
A dir1
A dir1/subdir1
A dir1/subdir1/testfile
A dir1/subdir2
A dir1/subdir2/testfile
A dir1/testfile
A dir2
A dir2/subdir1
A dir2/subdir1/testfile
A dir2/testfile
A testfile
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-full.20150108T185804Z.vol1.difftar.gz
Deleting /tmp/duplicity-gzjWQ7-tempdir/mktemp-LZ1B2R-2
AsyncScheduler: task completed successfully
Processed volume 1
--------------[ Backup Statistics ]--------------
StartTime 1420743484.04 (Fri Jan 9 05:58:04 2015)
EndTime 1420743484.05 (Fri Jan 9 05:58:04 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 12
SourceFileSize 168 (168 bytes)
NewFiles 12
NewFileSize 168 (168 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 12
RawDeltaSize 0 (0 bytes)
TotalDestinationSizeChange 252 (252 bytes)
Errors 0
-------------------------------------------------
All good so far. If I now run the same command with the progress flag the --exclude-globbing-filelist is ignored and dir2/subdir2/testfile will be backed up:
> duplicity --progress --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist "$location/exclude" "$location/src" file://"$location/dst"
Using archive dir: /home/scott/duplicity-test/.cache/test_backup
Using backup name: test_backup
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.cfbackend Succeeded
Import of duplicity.backends.copycombackend Succeeded
Import of duplicity.backends.dpbxbackend Failed: No module named dropbox
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Import of duplicity.backends.giobackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.megabackend Succeeded
Import of duplicity.backends.par2backend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.swiftbackend Succeeded
Import of duplicity.backends.sxbackend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Reading globbing filelist /home/scott/duplicity-test/exclude
Main action: inc
================================================================================
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --progress --archive-dir /home/scott/duplicity-test/.cache --name test_backup --no-encryption --verbosity 5 --exclude-globbing-filelist /home/scott/duplicity-test/exclude /home/scott/duplicity-test/src file:///home/scott/duplicity-test/dst
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
================================================================================
Using temporary directory /tmp/duplicity-tKtwsJ-tempdir
Temp has 35840000000 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: Fri Jan 9 05:58:04 2015
Deleting /tmp/duplicity-tKtwsJ-tempdir/mktemp-L3fYz0-2
Reading globbing filelist /home/scott/duplicity-test/exclude
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-SfAj0g-tempdir
Using temporary directory /home/scott/duplicity-test/.cache/test_backup/duplicity-odaZX9-tempdir
AsyncScheduler: instantiating at concurrency 0
A dir2/subdir2
A dir2/subdir2/testfile
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-inc.20150108T185804Z.to.20150108T190112Z.vol1.difftar.gz
Deleting /tmp/duplicity-tKtwsJ-tempdir/mktemp-bErzPB-3
AsyncScheduler: task completed successfully
Processed volume 1
0.0KB 00:00:03 [0.0KB/s] [========================================>] 100% ETA 0sec
--------------[ Backup Statistics ]--------------
StartTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
EndTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 14
SourceFileSize 184 (184 bytes)
NewFiles 2
NewFileSize 16 (16 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 2
RawDeltaSize 0 (0 bytes)
TotalDestinationSizeChange 137 (137 bytes)
Errors 0
-------------------------------------------------
I am experiencing the same problem and I've found it is triggered by the --progress flag.
The following demonstrates the problem: ~/duplicity- test /{.cache, src,dst} /src/{dir1, dir2}/{ subdir1, subdir2} src/dir2/ subdir2" > "$location/exclude" globbing- filelist "$location/exclude" "$location/src" file:// "$location/ dst" duplicity- test/.cache/ test_backup backends. botobackend Succeeded backends. cfbackend Succeeded backends. copycombackend Succeeded backends. dpbxbackend Failed: No module named dropbox backends. ftpbackend Succeeded backends. gdocsbackend Succeeded backends. giobackend Succeeded backends. hsibackend Succeeded backends. imapbackend Succeeded backends. localbackend Succeeded backends. megabackend Succeeded backends. par2backend Succeeded backends. rsyncbackend Succeeded backends. sshbackend Succeeded backends. swiftbackend Succeeded backends. sxbackend Succeeded backends. tahoebackend Succeeded backends. webdavbackend Succeeded duplicity- test/exclude ======= ======= ======= ======= ======= ======= ======= ======= ======= ======= === duplicity- test/.cache --name test_backup --no-encryption --verbosity 5 --exclude- globbing- filelist /home/scott/ duplicity- test/exclude /home/scott/ duplicity- test/src file:// /home/scott/ duplicity- test/dst ======= ======= ======= ======= ======= ======= ======= ======= ======= ======= === gzjWQ7- tempdir duplicity- test/.cache/ test_backup/ duplicity- xqRenW- tempdir duplicity- test/.cache/ test_backup/ duplicity- y6w8cZ- tempdir testfile testfile testfile full.20150108T1 85804Z. vol1.difftar. gz gzjWQ7- tempdir/ mktemp- LZ1B2R- 2 nSizeChange 252 (252 bytes) ------- ------- ------- ------- ------- -------
location=
mkdir -p "$location"
mkdir -p "$location"
find "$location/src" -type d -exec touch {}/testfile \;
echo "- $location/
duplicity --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-
Using archive dir: /home/scott/
Using backup name: test_backup
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Reading globbing filelist /home/scott/
Main action: inc
=======
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --archive-dir /home/scott/
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
=======
Using temporary directory /tmp/duplicity-
Temp has 35840032768 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: none
No signatures found, switching to full backup.
Using temporary directory /home/scott/
Using temporary directory /home/scott/
AsyncScheduler: instantiating at concurrency 0
A .
A dir1
A dir1/subdir1
A dir1/subdir1/
A dir1/subdir2
A dir1/subdir2/
A dir1/testfile
A dir2
A dir2/subdir1
A dir2/subdir1/
A dir2/testfile
A testfile
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-
Deleting /tmp/duplicity-
AsyncScheduler: task completed successfully
Processed volume 1
--------------[ Backup Statistics ]--------------
StartTime 1420743484.04 (Fri Jan 9 05:58:04 2015)
EndTime 1420743484.05 (Fri Jan 9 05:58:04 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 12
SourceFileSize 168 (168 bytes)
NewFiles 12
NewFileSize 168 (168 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 12
RawDeltaSize 0 (0 bytes)
TotalDestinatio
Errors 0
-------
All good so far. If I now run the same command with the progress flag the --exclude- globbing- filelist is ignored and dir2/subdir2/ testfile will be backed up: globbing- filelist "$location/exclude" "$location/src" file:// "$location/ dst" duplicity- test/.cache/ test_backup backends. botobackend Succeeded backends. cfbackend Succeeded backends. copycombackend Succeeded backends. dpbxbackend Failed: No module named dropbox backends. ftpbackend Succeeded backends. gdocsbackend Succeeded backends. giobackend Succeeded backends. hsibackend Succeeded backends. imapbackend Succeeded backends. localbackend Succeeded backends. megabackend Succeeded backends. par2backend Succeeded backends. rsyncbackend Succeeded backends. sshbackend Succeeded backends. swiftbackend Succeeded backends. sxbackend Succeeded backends. tahoebackend Succeeded backends. webdavbackend Succeeded duplicity- test/exclude ======= ======= ======= ======= ======= ======= ======= ======= ======= ======= === duplicity- test/.cache --name test_backup --no-encryption --verbosity 5 --exclude- globbing- filelist /home/scott/ duplicity- test/exclude /home/scott/ duplicity- test/src file:// /home/scott/ duplicity- test/dst ======= ======= ======= ======= ======= ======= ======= ======= ======= ======= === tKtwsJ- tempdir tKtwsJ- tempdir/ mktemp- L3fYz0- 2 duplicity- test/exclude duplicity- test/.cache/ test_backup/ duplicity- SfAj0g- tempdir duplicity- test/.cache/ test_backup/ duplicity- odaZX9- tempdir testfile inc.20150108T18 5804Z.to. 20150108T190112 Z.vol1. difftar. gz tKtwsJ- tempdir/ mktemp- bErzPB- 3 ======= ======= ======= ======= ======> ] 100% ETA 0sec nSizeChange 137 (137 bytes) ------- ------- ------- ------- ------- -------
> duplicity --progress --archive-dir "$location/.cache" --name test_backup --no-encryption --verbosity 5 --exclude-
Using archive dir: /home/scott/
Using backup name: test_backup
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Import of duplicity.
Reading globbing filelist /home/scott/
Main action: inc
=======
duplicity 0.7.0 ($reldate)
Args: /usr/bin/duplicity --progress --archive-dir /home/scott/
Linux ddsmash 3.16.0-28-generic #38-Ubuntu SMP Sat Dec 13 16:13:28 UTC 2014 x86_64 x86_64
/usr/bin/python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2]
=======
Using temporary directory /tmp/duplicity-
Temp has 35840000000 available, backup will use approx 34078720.
Local and Remote metadata are synchronised, no sync needed.
Last full backup date: Fri Jan 9 05:58:04 2015
Deleting /tmp/duplicity-
Reading globbing filelist /home/scott/
Using temporary directory /home/scott/
Using temporary directory /home/scott/
AsyncScheduler: instantiating at concurrency 0
A dir2/subdir2
A dir2/subdir2/
AsyncScheduler: running task synchronously (asynchronicity disabled)
Writing duplicity-
Deleting /tmp/duplicity-
AsyncScheduler: task completed successfully
Processed volume 1
0.0KB 00:00:03 [0.0KB/s] [======
--------------[ Backup Statistics ]--------------
StartTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
EndTime 1420743672.67 (Fri Jan 9 06:01:12 2015)
ElapsedTime 0.00 (0.00 seconds)
SourceFiles 14
SourceFileSize 184 (184 bytes)
NewFiles 2
NewFileSize 16 (16 bytes)
DeletedFiles 0
ChangedFiles 0
ChangedFileSize 0 (0 bytes)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 2
RawDeltaSize 0 (0 bytes)
TotalDestinatio
Errors 0
-------