errors in syncdaemon.log

Bug #608011 reported by Loïc Alejandro
20
This bug affects 3 people
Affects Status Importance Assigned to Milestone
ubuntuone-client (Ubuntu)
Confirmed
Undecided
Unassigned

Bug Description

Binary package hint: ubuntuone-client

I don't know if it is really a bug.
I want to sync 3 folders with a lot of small files in it.
It is veeeeeerrrrryyyy long.
And sometimes I see lines like those ones :
2010-07-21 01:42:09,974 - pyinotify - ERROR - add_watch: cannot watch /home/lalejand/Documents/ODIGI/IberOpale/iberOpale35/original/sources/binaries/jpg/_res/.svn/props (WD=-1)
2010-07-21 01:44:27,029 - pyinotify - ERROR - add_watch: cannot watch /home/lalejand/Documents/ODIGI/IberOpale/iberOpale36/model/sources/academic/gen/_xml/bs.doss/_common (WD=-1)

ProblemType: Bug
DistroRelease: Ubuntu 10.04
Package: ubuntuone-client 1.2.2-0ubuntu2
ProcVersionSignature: Ubuntu 2.6.32-23.37-generic 2.6.32.15+drm33.5
Uname: Linux 2.6.32-23-generic x86_64
NonfreeKernelModules: fglrx
Architecture: amd64
Date: Wed Jul 21 01:42:56 2010
InstallationMedia: Ubuntu 9.10 "Karmic Koala" - Release amd64 (20091027)
PackageArchitecture: all
ProcEnviron:
 LANG=fr_FR.UTF-8
 SHELL=/bin/bash
SourcePackage: ubuntuone-client
UbuntuOneSyncdaemonExceptionsLog:

UbuntuOneUserSyncdaemonConfig:
 [bandwidth_throttling]
 read_limit = 2097152
 write_limit = 2097152
 on = False

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :
Revision history for this message
Mitch Towner (kermiac) wrote :

I'm sorry to hear Ubuntu One is not working properly for you. If you would like to help debug the problem that would be greatly appreciated. You can do the following in order to provide important details that will help determine the root cause of this issue.

1) Quit the Ubuntu One client. Open Applications->Accessories->Terminal, then run the command:
u1sdtool -q

2) Run the following in the Terminal:
mv ~/.cache/ubuntuone/log ~/.cache/ubuntuone/log_old && mkdir ~/.cache/ubuntuone/log

3) Run the following in the Terminal to open/create this file:
gedit ~/.config/ubuntuone/syncdaemon.conf

#Add the following two (2) lines to this file and save:
[logging]
level = DEBUG

4) Run the following in the Terminal to start the ubuntu one deamon/service:
u1sdtool -c

5) Let Ubuntu One run for a while, copy some files into your Ubuntu One Folder.
Then attach your ubuntuone logs to this bug. Please zip your $HOME/.cache/ubuntuone/log/ folder and attach the zip here.

You can attach logs to this bug report by clicking the 'Add Attachment or patch' button at the bottom of the page. Thank you for filing this bug report and helping to make Ubuntu better.

Changed in ubuntuone-client (Ubuntu):
status: New → Incomplete
Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Ok, the syncdaemon is performing a rescan now. Last time it did, it took almost the whole day.
Should I wait for it to finish before adding a file in ubuntuone folder and send you the files you need ?

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

well, syncdaemon just finished rescanning right now (15 hours after)
Here is the zip of the log folder

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

I see a "partials" folder, see attachment. Don't know if it's normal.

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Now syncdaemon is performing a server rescan :
lalejand@tux-laptop:~$ u1sdtool -s
State: SERVER_RESCAN
    connection: With User With Network
    description: doing server rescan
    is_connected: True
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

Revision history for this message
Mitch Towner (kermiac) wrote :

Thank you for uploading the requested logs. I am assigning this to one of the developer teams so that they can investigate the issue further.

Changed in ubuntuone-client (Ubuntu):
status: Incomplete → Confirmed
tags: added: foundations+
Revision history for this message
Mitch Towner (kermiac) wrote :

Please also see Bug 607716

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

### 22 july, 3am ###
- server-rescan is finished :
lalejand@tux-laptop:~$ u1sdtool -s
State: WAITING
    connection: With User With Network
    description: waiting before try connecting again
    is_connected: False
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

- I open UO preferences window, I see my account (pay account) is recognized, but where it should be written "connected" it is written "unknown" and the "connect" button is not available.

- syncdaemon performs again a server_rescan :(
lalejand@tux-laptop:~$ u1sdtool -s
State: SERVER_RESCAN
    connection: With User With Network
    description: doing server rescan
    is_connected: True
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

- I go to sleep and leave the computer on all night long

### 22 july, 12am ###
- I wake up and now the UO preference window shows "syncing..." and I have a "disconnect" button, so everything seems normal (?).
u1sdtool -s gives me :
State: SERVER_RESCAN [again !!!!!!????]
    connection: With User With Network
    description: doing server rescan
    is_connected: True
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH
At the same time if I look to my UO in the web interface, I see that I'm still using 0 bytes of my storage space.
:(

Revision history for this message
John O'Brien (jdobrien) wrote : Re: [Bug 608011] Re: errors in syncdaemon.log

On 07/22/2010 07:35 AM, Loïc Alejandro wrote:
> ### 22 july, 3am ###
> - server-rescan is finished :
> lalejand@tux-laptop:~$ u1sdtool -s
> State: WAITING
> connection: With User With Network
> description: waiting before try connecting again
> is_connected: False
> is_error: False
> is_online: False
> queues: WORKING_ON_BOTH
>
> - I open UO preferences window, I see my account (pay account) is
> recognized, but where it should be written "connected" it is written
> "unknown" and the "connect" button is not available.
>
> - syncdaemon performs again a server_rescan :(
> lalejand@tux-laptop:~$ u1sdtool -s
> State: SERVER_RESCAN
> connection: With User With Network
> description: doing server rescan
> is_connected: True
> is_error: False
> is_online: False
> queues: WORKING_ON_BOTH
>
> - I go to sleep and leave the computer on all night long
>
> ### 22 july, 12am ###
> - I wake up and now the UO preference window shows "syncing..." and I have a "disconnect" button, so everything seems normal (?).
> u1sdtool -s gives me :
> State: SERVER_RESCAN [again !!!!!!????]
> connection: With User With Network
> description: doing server rescan
> is_connected: True
> is_error: False
> is_online: False
> queues: WORKING_ON_BOTH
> At the same time if I look to my UO in the web interface, I see that I'm still using 0 bytes of my storage space.
> :(
>

Can you check your ~/.cache/ubuntuone/log for syncdaemon-exception.* files that are not empty?

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

no syncdaemon-exception file

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

### Now ###

State: WAITING
    connection: With User With Network
    description: waiting before try connecting again
    is_connected: False
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

And "disconnected" state (it disconnected alone) in the UO pref window, still no exception in the log folder, still 0 bytes used in the web interface

### some minutes later ###

State: SERVER_RESCAN
    connection: With User With Network
    description: doing server rescan
    is_connected: True
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

And "syncing" state in the UO pref window, still no exception in the log folder, still 0 bytes used in the web interface

I attach a zip of the log folder now

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

well it seems that syncdaemon is in a cycle :
connect, server_rescan > disconnect, waiting > connect, server_rescan > disconnect, waiting > ...
And syncdaemon, when doing server_rescan is using almost 100% of my CPU :(

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Now it's in a "waiting" state, and in the log I have this suspicious line :
2010-07-23 00:56:35,703 - ubuntuone.SyncDaemon.ActionQueue - INFO - Connection failed: DNS lookup failed: address 'fs-1.one.ubuntu.com' not found: [Errno -5] No address associated with hostname.

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Can someone help ?
I have for the moment a ubuntu one pay account that makes my CPU be used to 95% by syncdaemon since 3 days now, and that doesn't allow me to sync anything (still 0 bytes used).

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

After reboot, syncdaemon performs again a local_rescan :
State: LOCAL_RESCAN
    connection: With User With Network
    description: doing local rescan
    is_connected: False
    is_error: False
    is_online: False
    queues: WORKING_ON_BOTH

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

Maybe what is happening now has a link with this bug I had : https://bugs.launchpad.net/bugs/607716
Syncdaemon (and nautilus) disliked some malformed name zip file, and I got some exceptions. Since that time, syncdaemon can't sync, and performs local_rescans and server_rescans.

Revision history for this message
John O'Brien (jdobrien) wrote :

On 07/23/2010 06:59 AM, Loïc Alejandro wrote:
> Maybe what is happening now has a link with this bug I had : https://bugs.launchpad.net/bugs/607716
> Syncdaemon (and nautilus) disliked some malformed name zip file, and I got some exceptions. Since that time, syncdaemon can't sync, and performs local_rescans and server_rescans.
>

That could be the problem, if you can go without scanning those directories until we get this resolved, here is how to
stop syncing them.

If you have an older client, you can do the following:

Get a list of folders you have syncing by entering: u1sdtool --list-folders

This will output something like this:
Folder list:
  id=9372d400-b6b5-4f8f-b400-5ee6c96dc217 subscribed=True path=/home/john/.ubuntuone/Purchased from Ubuntu One
  id=7197b90a-6d15-43c9-9f46-b310539d61c1 subscribed=True path=/home/john/Documents

Using id from the output for the folder, you can stop syncing it using the following command:

u1sdtool --delete-folder 7197b90a-6d15-43c9-9f46-b310539d61c1

I hope this helps.

Revision history for this message
John O'Brien (jdobrien) wrote :

That could be the problem, if you can go without scanning those directories until we get this resolved, here is how to
stop syncing them.

If you have an older client, you can do the following:

Get a list of folders you have syncing by entering: u1sdtool --list-folders

This will output something like this:
Folder list:
  id=9372d400-b6b5-4f8f-b400-5ee6c96dc217 subscribed=True path=/home/john/.ubuntuone/Purchased from Ubuntu One
  id=7197b90a-6d15-43c9-9f46-b310539d61c1 subscribed=True path=/home/john/Documents

Using id from the output for the folder, you can stop syncing it using the following command:

u1sdtool --delete-folder 7197b90a-6d15-43c9-9f46-b310539d61c1

I hope this helps.

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

I have error lines in the log like this one : 2010-07-29 10:57:12,536 - pyinotify - ERROR - add_watch: cannot watch /home/lalejand/Documents/ODIGI/OdigiImmo/odigiImmoTotal/sources/odigiImmo/generateurWeb/transformers/.svn/text-base (WD=-1), but syncdaemon-exceptions.log stays empty :(

Maybe this kind of error makes syncdaemon rescan and rescan and rescan for ever.

Revision history for this message
Loïc Alejandro (loic-alejandro) wrote :

[12:39] <rye> lalejand, ok, now we know why that inotify error was happening, max amount of watches was 8k, you have 35k of directories
[12:42] <rye> lalejand, the other concern is the number of files in your directories, when syncdaemon is rescanning your system it adds a watch to every directory, after 8192 directories it stopped adding watches and was not able to do anything, now it will be able to do anything but local rescan can take really long time
[12:45] <rye> lalejand, anyway you might need to add fs.inotify.max_user_watches = 524288 to /etc/sysctl.conf
[12:52] <lalejand> rye : cat ~/.cache/ubuntuone/log/syncdaemon.log | grep ERROR >>> nothing :))))))

Why the limit is so low by default ?

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.