scan fails with 2.0.2

I've tried scanning with --verbose a couple of times, and it seems to crash randomly.

A possible cause of this is that the previous falcon run crashed. (due to your other bug for instance). Remove the database log file (in .falcon) and try again.

Actually, bug 181022 will cause this. As of 2.0.4, falcon won't die a horrible death if this ever happens again but properly warn. Remove .falcon/data-journal to get rid of this message.

Still happens with 2.0.3. There is no log in .falcon, only "lock" and "data". Configuring leaves the lock in place, but removing that doesn't do anything.

actually the error is slightly different now:

Traceback (most recent call last):
  File "/usr/bin/falcon", line 235, in ?
    component.scan(clean = action=='clean')
  File "/usr/lib/python2.4/site-packages/falcon/plugin.py", line 157, in wrapped_func
    result = func(*args, **kwargs)
  File "/usr/lib/python2.4/site-packages/falcon/pocket.py", line 184, in scan
    newfiles = s.rescan()
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 195, in rescan
    self.get_binaries(missing_only=True)
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 133, in get_binaries
    BinaryPackage.create_from_debfile(self, f)
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 261, in create_from_debfile
    p.save()
  File "/var/lib/python-support/python2.4/django/db/models/base.py", line 238, in save
    ','.join(placeholders)), db_values)
  File "/var/lib/python-support/python2.4/django/db/backends/sqlite3/base.py", line 93, in execute
    return Database.Cursor.execute(self, query, params)
OperationalError: database is locked

and another variant:

Traceback (most recent call last):
  File "/usr/bin/falcon", line 235, in ?
    component.scan(clean = action=='clean')
  File "/usr/lib/python2.4/site-packages/falcon/plugin.py", line 157, in wrapped_func
    result = func(*args, **kwargs)
  File "/usr/lib/python2.4/site-packages/falcon/pocket.py", line 190, in scan
    s = falcon.package.SourcePackage.create_from_dscfile(self, s)
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 54, in create_from_dscfile
    c.get_binaries()
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 133, in get_binaries
    BinaryPackage.create_from_debfile(self, f)
  File "/usr/lib/python2.4/site-packages/falcon/package.py", line 261, in create_from_debfile
    p.save()
  File "/var/lib/python-support/python2.4/django/db/models/base.py", line 238, in save
    ','.join(placeholders)), db_values)
  File "/var/lib/python-support/python2.4/django/db/backends/sqlite3/base.py", line 93, in execute
    return Database.Cursor.execute(self, query, params)
OperationalError: database is locked

I really hope that the errors don't mean that every package should have a valid source package.. since there are packages like skype that don't have a source package available.

This error means that somehow you try to access the database simultaneously from 2 programs, which should not happen since falcon has its own global lock. What does ls -la .falcon tell you?

deckard ubuntu-tkk 3 % ls -l .falcon
total 864
drwxr-xr-x 4 tjaalton sasl 4096 2007-11-06 16:37 build
drwxr-xr-x 2 tjaalton sasl 8192 2007-11-26 14:07 changelogs
-rw-r--r-- 1 tjaalton sasl 855040 2008-01-08 09:34 data
drwxr-xr-x 2 tjaalton sasl 4096 2007-11-06 16:37 incoming
-rw-r--r-- 1 tjaalton sasl 5 2008-01-08 09:33 lock
drwxr-xr-x 2 tjaalton sasl 8192 2007-11-26 14:07 morgue

it always leaves the lock behind, and falcon starts just fine even if it exists.

Could you do the following to reset the package tables:

$ falcon shell
>>> SourcePackage.objects.all().delete()
>>> BinaryPackage.objects.all().delete()
$ falcon -v scan

If that breaks, send the complete output, preferably with an ls -lar pool

2.0.5 is out which will warn if the database is locked.

Yeah, and with 2.0.5 the scan went fine, so I'll close this as fixed, thanks!