Merge lp:~unit193/bzr-fastimport/deletion-fixes into lp:bzr-fastimport

[Unit 193]

This fixes several outstanding export issues, patch taken from bug 430347.

[Richard Wilbur (richard-wilbur)]

Thanks Unit 193 for the patch. It looks well executed.

How hard do you think it would be to create a test (or tests) to demonstrate the problem(s) (absent the fix) and validate the fix? This is important to make sure no one else accidentally breaks this fix, reintroducing the problem(s), in the future.

review: Needs Information (needs test(s))

[Unit 193 (unit193)]

I'd presume it wouldn't be too hard for someone used to the test framework, or writing tests. However, I am not that person.

[Richard Wilbur (richard-wilbur)]

I'll take a look at it and see if I can implement some decent tests within the test framework to cover the situations mentioned in all three linked bugs.

[Unit 193 (unit193)]

Is there any chance of getting this in? I've been using it ever since, and it's quite helpful to me so should equally be useful to others.

[Jelmer Vernooij (jelmer)]

Please add some unit tests for it.

It's the kind of change that's likely to regress as other changes are made, and it is not clear to me that it won't have other fallout (and e.g. make files disappear that should be exported) - tests are a good way to demonstrate that.

[Jelmer Vernooij (jelmer)]

There are also linked bugs that e.g. include smaller fixes - without having looked closely at the code, why are these fixes not appropriate?

[Balint Reczey (rbalint)]

@richard-wilbur The offered patch is applied in Ubuntu since 0.13.0+bzr361-1ubuntu1. Please consider merging it with or without an additional test.
It testing is really needed adding it to autopkgtests would be super easy.

Unmerged revisions

361. By Unit 193 on 2015-05-04

Fix a case where deleteion of an entry in a renamed directory is not reproduced correctly in fast-export. Thanks to Harry Hirsch, Nuno Araujo, and Andrew Huff for the patch.

=== modified file 'exporter.py'
--- exporter.py	2014-05-15 09:26:03 +0000
+++ exporter.py	2015-05-04 13:31:46 +0000
@@ -514,6 +514,7 @@
         #
         # 1) bzr rm a; bzr mv b a; bzr commit
         # 2) bzr mv x/y z; bzr rm x; commmit
+        # 3) bzr mv x y; bzr rm y/z; bzr commit
         #
         # The first must come out with the delete first like this:
         #
@@ -525,6 +526,11 @@
         # R x/y z
         # D x
         #
+        # The third case must come out with delete first like this:
+        #
+        # D x/z
+        # R x y
+        #
         # So outputting all deletes first or all renames first won't work.
         # Instead, we need to make multiple passes over the various lists to
         # get the ordering right.
@@ -532,6 +538,7 @@
         must_be_renamed = {}
         old_to_new = {}
         deleted_paths = set([p for p, _, _ in deletes])
+        deleted_child_paths = set()
         for (oldpath, newpath, id_, kind,
                 text_modified, meta_modified) in renames:
             emit = kind != 'directory' or not self.plain_format
@@ -543,6 +550,20 @@
                 self.note("Skipping empty dir %s in rev %s" % (oldpath,
                     revision_id))
                 continue
+                
+            if kind == 'directory':
+                # handling deleted children in renamed directory (case 3 above)
+                for p, e in tree_old.inventory.iter_entries_by_dir(from_dir=id_):
+                    if e.kind == 'directory' or not self.plain_format:
+                        continue
+                    old_child_path = osutils.pathjoin(oldpath, p)
+                    new_child_path = osutils.pathjoin(newpath, p)
+                    if old_child_path in deleted_paths:
+                        file_cmds.append(commands.FileDeleteCommand(old_child_path.encode("utf-8")))
+                        deleted_paths.remove(old_child_path)
+                        deleted_child_paths.add(old_child_path)
+
+                
             #oldpath = self._adjust_path_for_renames(oldpath, renamed,
             #    revision_id)
             renamed.append([oldpath, newpath])
@@ -561,6 +582,8 @@
                         continue
                     old_child_path = osutils.pathjoin(oldpath, p)
                     new_child_path = osutils.pathjoin(newpath, p)
+                    if old_child_path in deleted_child_paths:
+                        continue
                     must_be_renamed[old_child_path] = new_child_path
 
         # Add children not already renamed