Empty backup created

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Hi,

Did you include the /home/<user> directory ?

You should include a parent directory and then exclude sub directories. Is it what you are doing ? You can check the includes.list file in the backup to see what has been included.

Regards
wattazoum

Well, that probably is the answer. I will check it in a minute.
Why is it, that you need a parent directory, before you can exclude directories?

Well, it's not that you NEED a parent directory.The exclusion is anyway taken into acount. But if you don't include any directory, the exclusion are meaningless IMO.

Ok, look: I had 2 directories enabled, I just wanted to make extremely sure that certain directories were not being copied:

[dirconfig]
/home/abonnema/Documents/00-private/00-films/ = 0
/home/abonnema/audio/ = 1
/home/abonnema/projects/kdenlive/ = 0
/work/thuis/ = 1

As you can see, 2 directories were enabled, but my resulting file was empty.

So, even though the exclusions were pointless, I should have had at least 2 directoiries with contents.

This is weird. I tried to use the same kind of config as yours and it's working fine.
Can you paste the content of the includes.list and excludes.list file of your backup here ?
I would also like the content of your nssbackup log file (if there is nothing sensitive inside).

Hi Oumar,

I suspect something else is wrong.

I entered a completely different [dirconfig] and got the same result.
The following files are created on the remote site:

ncftp ...alhost.localdomain.ful > ls -l
-rw-r--r-- support support 8 Sep 23 05:22 excludes
-rw-r--r-- support support 106 Sep 23 05:23 excludes.list
-rw-r--r-- support support 130 Sep 23 05:23 excludes.list.tmp
-rw-r--r-- support support 0 Sep 23 05:23 files.tar.gz
-rw-r--r-- support support 6 Sep 23 05:22 format
-rw-r--r-- support support 104 Sep 23 05:23 includes.list
-rw-r--r-- support support 104 Sep 23 05:23 includes.list.tmp
-rw-r--r-- support support 0 Sep 23 05:22 packages

As you can see the files.tar.gz is empty.

The filespec used was:

ncftp ...alhost.localdomain.ful > cat includes.list
/home/abonnema/Documents/00-private
/work/thuis
/ddisk/backup/00-keyfiles
/ddisk/backup/00-protected-01

ncftp ...alhost.localdomain.ful > cat excludes.list

/sys/*
/tmp/*
/proc/*
/dev/*
/<email address hidden>

The relevant portion of the log is:

2009-09-23 05:24:48,593 - INFO - BackupManager.py:makeBackup(310) - Starting snapshot 2009-09-23_05.24.46.270400.localhost.localdomain.ful
2009-09-23 05:24:48,594 - INFO - BackupManager.py:makeBackup(323) - Setting packages File
2009-09-23 05:24:48,623 - INFO - BackupManager.py:makeBackup(333) - Setting Excludes File
2009-09-23 05:24:48,625 - INFO - BackupManager.py:makeBackup(341) - Setting compression format
2009-09-23 05:24:48,626 - INFO - BackupManager.py:makeBackup(346) - Setting split size
2009-09-23 05:25:47,643 - INFO - tar.py:makeTarFullBackup(344) - Launching TAR to make a Full backup
2009-09-23 05:27:05,239 - ERROR - nssbackupd.py:__onError(226) - Given copy destination '/<email address hidden>/2009-09-23_05.24.46.270400.localhost.localdomain.ful' does not exist.
2009-09-23 05:27:05,290 - ERROR - nssbackupd.py:__onError(227) - Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/nssbackup/nssbackupd.py", line 217, in run
    self.__bm.makeBackup()
  File "/usr/lib/python2.6/site-packages/nssbackup/managers/BackupManager.py", line 364, in makeBackup
    self.__actualSnapshot.commit()
  File "/usr/lib/python2.6/site-packages/nssbackup/util/Snapshot.py", line 344, in commit
    self.__makebackup()
  File "/usr/lib/python2.6/site-packages/nssbackup/util/Snapshot.py", line 538, in __makebackup
    TAR.makeTarFullBackup(self)
  File "/usr/lib/python2.6/site-packages/nssbackup/util/tar.py", line 372, in makeTarFullBackup
    Util.nssb_copy( tmp_snarfile, snarfile )
  File "/usr/lib/python2.6/site-packages/nssbackup/util/__init__.py", line 113, in nssb_copy
    prep_src, prep_dst = _prepare_nssb_copy(src, dst)
  File "/usr/lib/python2.6/site-packages/nssbackup/util/__init__.py", line 160, in _prepare_nssb_copy
    raise IOError("Given copy destination '%s' does not exist." % _dst_dir)
IOError: Given copy destination '/<email address hidden>/2009-09-23_05.24.46.270400.localhost.localdomain.ful' does not exist.

2009-09-23 05:27:05,304 - INFO - BackupManager.py:__unsetlockfile(565) - Session of backup is finished (/home/abonnema/.local/share/nssbackup/nssbackup.lock is removed)

The error I see is weird, because the files are stored, it's just that files.tar.gz is empty.
Also I got a bunch of the following errors for files already at the remote site:

2009-09-23 05:24:46,270 - WARNING - SnapshotManager.py:_read_snps_from_disk_allformats(174) - Got a non valid snapshot 'signature' due to name convention : Name of Snapshot not valid : False

So, that's it. Hope you can make heads or tail of it.

Guus.

Hi,
Thanks for the info. The fact that there are some *.tmp files in your backups means that it wasn't correctly finished. Looking at the logs, we can also know why it didn't finish.

IOError: Given copy destination '/<email address hidden>/2009-09-23_05.24.46.270400.localhost.localdomain.ful' does not exist.

Even though the logs says that the destination doesn't exist, I suspect that it was existing (since NSsbackup created files inside) but it has been disconnected. Maybe you FTP provider 'ibackup' cuts the connection after 1 minute of inaction. Can you check that by connecting their using an ftp client and wait for 2 minutes. Look in you client logs to see if it tells you that you were disconnected.

I am using free.fr my self, and they seems to have a timeout of 45 seconds. This could cause this kind of issues. If you can confirm that, I will try to find a solution for this.

Hi,

I tried ncftp on two occasions and both times the sessions appears to run "forever".
However, when check the trace file it generates I found a time-out of 1200 seconds (20 minutes).
I am not sure this is a server time-out or a client time-out.

I will attach the trace here. As I don't see how to attach a file, I will copy the text here.

"
SESSION STARTED at: 2009-10-04 17:10:41 CEST +0200
Program Version: NcFTP 3.2.2/409 Aug 18 2008, 10:48 PM compiled for linux-x86_64-glibc2.9
Compiled for: linux-x86_64-glibc2.9
Process ID: 3985
Hostname: localhost.localdomain (rc=2)
Terminal: xterm
17:10:41 Fw: firewall.localdomain Type: 0 User: <userid> Pass: ******** Port: 21
17:10:41 FwExceptions: .localdomain,localhost,localdomain
17:10:49 > bookmark

17:10:54 > ?

17:11:06 > open ibackup

17:11:06 Resolving ftp.ibackup.com...
17:11:06 Connecting to 64.14.192.121...
17:11:06 LibNcFTP 3.2.3 (August 18, 2008) compiled for linux-x86_64-glibc2.9
17:11:06 Uname: Linux|localhost.localdomain|2.6.30.8-64.fc11.x86_64|#1 SMP Fri Sep 25 04:43:32 EDT 2009|x86_64
17:11:06 Contents of /etc/fedora-release:
17:11:06 Fedora release 11 (Leonidas)
17:11:06 Contents of /etc/redhat-release:
17:11:06 Fedora release 11 (Leonidas)
17:11:06 Contents of /etc/issue:
17:11:06 Fedora release 11 (Leonidas)
17:11:06 Kernel \r on an \m (\l)
17:11:06 Glibc: 2.10.1 (stable)
17:11:07 Logging in...
17:11:07 220: IBackup FTP Server Ready.
17:11:07 Connected to 64.14.192.121.
17:11:07 Cmd: USER <userid>
17:14:36 331: User <userid> okay, need password.
17:14:36 Cmd: PASS xxxxxxxx
17:14:36 Remote host has closed the connection.
17:14:36 421: Disconnecting you since you didn't login successfully within 60 seconds.
17:14:36 Sleeping 19 seconds.
17:14:36 Sleeping 19 seconds...
17:14:55 Retry Number: 1
17:14:55 Redialing (try 1)...
17:14:56 Logging in...
17:14:56 220: IBackup FTP Server Ready.
17:14:56 Connected to 64.14.192.121.
17:14:56 Cmd: USER <userid>
17:14:57 331: User <userid> okay, need password.
17:14:57 Cmd: PASS xxxxxxxx
17:14:57 Logging in...
17:14:57 230: Restricted user logged in.
17:14:57 Cmd: PWD
17:14:57 257: "/" is cwd.
17:14:57 Logged in to 64.14.192.121 as <userid>.
17:14:57 Cmd: FEAT
17:14:57 211: Extensions supported:
17:14:57 CLNT
17:14:57 MDTM
17:14:57 MLST type*;size*;modify*;UNIX.mode*;UNIX.owner;UNIX.uid;UNIX.group;UNIX.gid;unique
17:14:57 PASV
17:14:57 REST STREAM
17:14:57 SIZE
17:14:57 TVFS
17:14:57 Compliance Level: 19981201 (IETF mlst-05)
17:14:57 End.
17:14:57 Cmd: HELP SITE
17:14:58 214: The following SITE commands are recognized:
17:14:58 BUFSIZE
17:14:58 CHMOD
17:14:58 DF
17:14:58 QUOTA
17:14:58 RBUFSIZ
17:14:58 RBUFSZ
17:14:58 RETRBUFSIZE
17:14:58 SBUFSIZ
17:14:58 SBUFSZ
17:14:58 STORBUFSIZE
17:14:58 SYMLINK
17:14:58 UMASK
17:14:58 UTIME
17:14:58
17:14:58 Logged in to ftp.ibackup.com.
17:14:58 Cmd: CWD 2009-09-23_05.24.46.270400.localhost.localdomain.ful
17:14:58 250: "/2009-09-23_05.24.46.270400.localhost.localdomain.ful" is new cwd.
17:14:58 Current remote directory is /2009-09-23_05.24.46.270400.localhost.localdomain.ful.
17:14:58 Cmd: CLNT NcFTP 3.2.2 linux-x86_64-glibc2.9
17:14:58 200: Noted.
17:15:02 > ls -l

17:15:02 Cmd: OPTS MLST type;size;modify;UNIX.mode;UNIX.owner;UNIX.uid;UNIX.group;UNIX.gid;
17:15:02 200: Options accepted: type;size;modify;UNIX.mode;UNIX.owner;UNIX.uid;UNIX.group;UNIX.gid
17:15:02 Cmd: PASV
17:15:03 227: Entering Passive Mode (64,14,192,121,147,220)
17:15:03 Cmd: MLSD
17:15:03 150: Data connection accepted from 82.95.118.124:56070; transfer starting.
17:15:03 226: Listing completed.
17:15:03 Remote listing contents {
17:15:03 type=cdir;modify=20090923032340;UNIX.mode=0755;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 /2009-09-23_05.24.46.270400.localhost.localdomain.ful
17:15:03 type=pdir;modify=20090923032227;UNIX.mode=0755;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 /
17:15:03 type=file;size=8;modify=20090923032254;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 excludes
17:15:03 type=file;size=106;modify=20090923032327;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 excludes.list
17:15:03 type=file;size=130;modify=20090923032321;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 excludes.list.tmp
17:15:03 type=file;size=0;modify=20090923032340;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 files.tar.gz
17:15:03 type=file;size=6;modify=20090923032241;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 format
17:15:03 type=file;size=104;modify=20090923032311;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 includes.list
17:15:03 type=file;size=104;modify=20090923032306;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 includes.list.tmp
17:15:03 type=file;size=0;modify=20090923032257;UNIX.mode=0644;UNIX.owner=support;UNIX.uid=503;UNIX.group=support;UNIX.gid=503 packages
17:15:03 }
17:15:03 -rw-r--r-- support support 8 Sep 23 05:22 excludes
17:15:03 -rw-r--r-- support support 106 Sep 23 05:23 excludes.list
17:15:03 -rw-r--r-- support support 130 Sep 23 05:23 excludes.list.tmp
17:15:03 -rw-r--r-- support support 0 Sep 23 05:23 files.tar.gz
17:15:03 -rw-r--r-- support support 6 Sep 23 05:22 format
17:15:03 -rw-r--r-- support support 104 Sep 23 05:23 includes.list
17:15:03 -rw-r--r-- support support 104 Sep 23 05:23 includes.list.tmp
17:15:03 -rw-r--r-- support support 0 Sep 23 05:22 packages
17:18:49 >

17:28:30 >

17:32:46 >

17:46:58 >

17:51:11 >

18:46:29 >

18:48:33 >

18:49:21 Cmd: QUIT
18:49:21 421: Disconnecting you since you were inactive for 1200 seconds.
SESSION ENDED at: Sun Oct 4 18:49:21 2009

"

HI,

I just wanted to add, that ncftp apparantly doesn't show exactly when it breaks connection. I connection running without any message for all day, but when I did a " ls -l" I got the following message:

ncftp / > ls -l
Could not write to control stream: Broken pipe.
Passive mode refused.

So I have no idea when the connection closed. But I am quite sure it was not one or two minutes.

Hope this helps.

This question was expired because it remained in the 'Open' state without activity for the last 15 days.

Sorry, I didn't have time to take care of the follow-up of this question.

This question was expired because it remained in the 'Open' state without activity for the last 15 days.