lp:~jderose/dmedia/trunk

Branch merges

Propose for merging

No branches dependent on this one.

Related source package recipes

No recipes using this branch. (?)

Create packaging recipe

Related snap packages

Related bugs

Bug #671949: Add quick id function to speed up import dedup	High	Fix Released
Bug #672273: Use plain unittest instead of nose, use desktopcouch test idioms, make `setup.py test` work	Critical	Fix Released
Bug #677837: dmedia file hardcodes .config for getting the filename to couchdb html file. use xdg.BaseDirectory instead	Undecided	Fix Released

Link a bug report

Related blueprints

114. By Jason Gerard DeRose on 2010-11-24

Merged David Green's dmedia man page

113. By Jason Gerard DeRose on 2010-11-21

Decided to not print warning about content-hash/schema not being final at end of every dmedia script run (there are better places to do that)

112. By Jason Gerard DeRose on 2010-11-21

Fixed MANIFEST.in so dmedialib/data/* and dmedialib/tests/data/* are included

111. By Jason Gerard DeRose on 2010-11-20

Merged xdg.BaseDirectory fix from ~manishsinha

Merged branch lp:~manishsinha/dmedia/remove-hardcoding-use-xdg-dot-basedirectory

Bug #677837: dmedia file hardcodes .config for getting the filename to couchdb html file. use xdg.BaseDirectory instead

110. By Jason Gerard DeRose on 2010-11-19

Fixed oops in safe_ext() that broke cr2 extensions

109. By Jason Gerard DeRose on 2010-11-19

A few cleanups preparing for 0.1, including:

 * Thumbnail is again stored in _attachments as I'm undecided and at least
   there it's browse-able in Futon
 * dmedia script now prints instructions on how to open desktopcouch in a
   browser, along with a warning about the dmedia hash/schema not being final
 * Various small cleanups, added more docstrings to FileStore
 * Added safe_ext() to validate file extension, an avenue for path traversal
   attacks that I missed the first time
 * Changed license to AGPLv3 as dmedia is made of the web, baby

108. By Jason Gerard DeRose on 2010-11-17

FileStore.allocate_tmp() now returns open file instead of path; tmp now opened in mode 'r+b' when fallocate works

107. By Jason Gerard DeRose on 2010-11-17

FileStore re-factor, security enhancements, import improvements

This is the big 0.1 re-factor, which:

  * Re-factors FileStore to remove details about high-level import operations,
    metadata in CouchDB doc, etc. FileStore is now quite stand-alone.

  * Adds rigorous security features in FileStore to protect against
    directory/path traversal. A WSGI app (native dmedia server) can now be
    built atop FileStore quite safely (although such an app should still design
    for security and assume the FileStore protections don't work).

  * Adds `quickid` to doc in order to speed-up de-duplication during imports
    (but the full content-hash is still used for the `_id`).

  * When importing files across different filesystems, the copy and hash are now
    done in a single pass thanks to the new filestore.copy_and_hash() function.
    This hugely improves throughput for large files that don't fully fit in the
    page cache (as they would previously be read from the source filesystem
    twice).

  * Better locking during import operations to prevent mid-air collisions. The
    source file is now kept open in 'rb' mode till the import completes,
    preventing the file from being modified. Care is also taken to rely on the
    source filename as little as possible (in case it's renamed during the
    import).

  * Relocates badly placed import functionality from `dmedia` script to new
    `import.py` module.

106. By Jason Gerard DeRose on 2010-11-14

Merged Akshat's quick_id() fuction. Thanks, Akshat\!

Merged branch lp:~akshatj/dmedia/quick-id

Bug #671949: Add quick id function to speed up import dedup

105. By Jason Gerard DeRose on 2010-11-13

Added HACKING.txt with instructions for new contributors