Newsgroup: it.comp.os.linux.sys
Titolo: Problema snervante con amanda

<premessa>
Scusate la lunghezza ma ho dovuto ;-)
</premessa>
Ciao, con amanda e su tape HP-1537A SCSI, non riesco a fare quadrare i
backup. Ho 3 hosts, due da 50MB e 1.5GB dumpati direttamente col
client amanda mentre un terzo da 8GB dumpato tramite samba. Ebbene
quello da 50MB va benone sempre, quello da 8 giga invece mi va
(random) in timeout e quindi mi fa un backup parziale, mentre quello
via samba (niente firewall fra i due, cosě come quello da 50MB) lo fa
di dimensione sbagliata, a volte completo e a volte da neanche 1GB.
Non riesco assolutamente a capire il perchč, la configurazione delle
cassette č ottenuta con il comando 'tapetype' quindi dovrebbe essere
giusta, firewall in mezzo non ce n'č e io non so dove sbattere la
testa.
Il config di amanda :
--------------------------------
org "DailySet1"                # your organization name for reports
mailto "
pi...@admin.it
"    # space separated list of operators
dumpuser "backup"        # the user to run dumps under
inparallel 3                # maximum dumpers that will run in parall
netusage  20000                # maximum net bandwidth  KB per sec
dumpcycle 10 days        # the number of days in the normal dump cycle
tapecycle 10 tapes        # the number of tapes in rotation
bumpsize 20 MB                # minimum savings 
bumpdays     1                # minimum days at each level
bumpmult     4                # threshold = bumpsize 
tapedev        "/dev/nst0"        # Linux @ tuck, norewinding
tapetype HP-DDS3                # what kind tape
labelstr "^MTI[0-9][0-9]*$"        # label
diskdir "/space"                # where the holding disk is
disksize 16000 MB                        # how much space
infofile "/var/lib/amanda/DailySet1/curinfo"        # dtabase filename
logfile  "/var/log/amanda/DailySet1/log"        # log filename
indexdir "/var/lib/amanda/DailySet1/index"
define tapetype HP-DDS3 {
   comment "just produced by tapetype program"
   length 22854 mbytes
   filemark 0 kbytes
   speed 963 kps
}
 
define dumptype high-tar {
   program "GNUTAR"
   comment "partitions dumped with tar"
   options no-compress
   priority high
}
----------------------------------
Il log (lo so che č grandicello, perdonatemi) di amdump :
---------------------------
amdump: start at Sat May 25 01:46:02 CEST 2002
planner: pid 7160 executable /usr/lib/amanda/planner version 2.4.2p2
planner: build: VERSION="Amanda-2.4.2p2"
planner:        BUILT_DATE="Tue Apr 2 21:24:21 UTC 2002"
planner:        BUILT_MACH="Linux cyberhq 2.4.18pre2 #1 SMP Tue Jan 8
18:13:43 PST 2002 i686 unknown"
planner:        CC="gcc"
planner: paths: bindir="/usr/sbin" sbindir="/usr/sbin"
planner:        libexecdir="/usr/lib/amanda" mandir="/usr/share/man"
planner:        AMANDA_TMPDIR="/tmp/amanda"
AMANDA_DBGDIR="/tmp/amanda"
planner:        CONFIG_DIR="/etc/amanda" DEV_PREFIX="/dev/"
planner:        RDEV_PREFIX="/dev/r" DUMP="/sbin/dump"
planner:        RESTORE="/sbin/restore"
SAMBA_CLIENT="/usr/bin/smbclient"
planner:        GNUTAR="/bin/tar" COMPRESS_PATH="/bin/gzip"
planner:        UNCOMPRESS_PATH="/bin/gzip" MAILER="/usr/bin/Mail"
planner:        listed_incr_dir="/var/lib/amanda/gnutar-lists"
planner: defs:  DEFAULT_SERVER="localhost" DEFAULT_CONFIG="DailySet1"
planner:        DEFAULT_TAPE_SERVER="localhost"
planner:        DEFAULT_TAPE_DEVICE="/dev/null" HAVE_MMAP HAVE_SYSVSHM
planner:        LOCKING=POSIX_FCNTL SETPGRP_VOID DEBUG_CODE
planner:        AMANDA_DEBUG_DAYS=4 BSD_SECURITY USE_AMANDAHOSTS
planner:        CLIENT_LOGIN="backup" FORCE_USERID HAVE_GZIP
planner:        COMPRESS_SUFFIX=".gz" COMPRESS_FAST_OPT="--fast"
planner:        COMPRESS_BEST_OPT="--best" UNCOMPRESS_OPT="-dc"
planner: dgram_bind: socket bound to 0.0.0.0.690
READING CONF FILES...
driver: pid 7161 executable /usr/lib/amanda/driver version 2.4.2p2
driver: send-cmd time 0.010 to taper: START-TAPER 20020525
startup took 0.031 secs
SETTING UP FOR ESTIMATES...
setting up estimates for ctrl.pippo.it:/archivio
setup_estimate: ctrl.pippo.it:/archivio: command 0, options:
   last_level 1 next_level0 8 level_days 1
   getting estimates 0 (44650) 1 (44110) 2 (0)
setting up estimates for 
backup.pippo.it
://Servermti/backupz
setup_estimate: 
backup.pippo.it
://Servermti/backupz: command 0,
options:
   last_level 1 next_level0 7 level_days 2
   getting estimates 0 (8881925) 1 (856095) 2 (0)
setting up estimates for web.pippo.net:/home
setup_estimate: web.pippo.net:/home: command 0, options:
   last_level 1 next_level0 6 level_days 1
   getting estimates 0 (3198190) 1 (70590) 2 (0)
setting up estimates took 0.017 secs
GETTING ESTIMATES...
taper: pid 7162 executable taper version 2.4.2p2
driver: started dumper0 pid 7166
driver: started dumper1 pid 7167
got result for host 
ctrl.pippo.it
 disk /archivio: 0 -> 45540K, 1 ->
44210K, 2 -> 44210K
dumper: dgram_bind: socket bound to 0.0.0.0.696
dumper: pid 7166 executable dumper version 2.4.2p2, using port 696
taper: read label `MTI04' date `20020517'
dumper: dgram_bind: socket bound to 0.0.0.0.698
dumper: pid 7168 executable dumper version 2.4.2p2, using port 698
taper: wrote label `MTI04' date `20020525'
dumper: dgram_bind: socket bound to 0.0.0.0.697
dumper: pid 7167 executable dumper version 2.4.2p2, using port 697
driver: started dumper2 pid 7168
got result for host 
backup.pippo.it
 disk //Servermti/backupz: 0 ->
8908420K, 1 -> 930847K, 2 -> 930847K
error result for host 
web.pippo.net
 disk /home: Request to
web.pippo.net
 timed out.
getting estimates took 2700.448 secs
FAILED QUEUE:
 0: 
web.pippo.net
 /home
DONE QUEUE:
 0: 
ctrl.pippo.it
 /archivio
 1: 
backup.pippo.it
 //Servermti/backupz
ANALYZING ESTIMATES...
pondering ctrl.pippo.it:/archivio... next_level0 8 last_level 1 (not
due for a full dump, picking an incr level)
  pick: size 44210 level 1 days 1 (thresh 20480K, 1 days)
  pick: next size 44210... not bumped
 curr level 1 size 44210 total size 44306 total_lev0 0
balanced-lev0size 4554
pondering 
backup.pippo.it
://Servermti/backupz... next_level0 7
last_level 1 (not due for a full dump, picking an incr level)
  pick: size 930847 level 1 days 2 (thresh 20480K, 1 days)
  pick: next size 930847... not bumped
 curr level 1 size 930847 total size 975185 total_lev0 0
balanced-lev0size 895396
planner: FAILED 
web.pippo.net
 /home 0 [Request to 
web.pippo.net
 timed
out.]
INITIAL SCHEDULE (size 975185):
 
backup.pippo.it
 //Servermti/backupz pri 2 lev 1 size 930847
 
ctrl.pippo.it
 /archivio pri 2 lev 1 size 44210
DELAYING DUMPS IF NEEDED, total_size 975185, tape length 23402496 mark
0
 delay: Total size now 975185.
PROMOTING DUMPS IF NEEDED, total_lev0 0, balanced_size 895396...
  promote: checking up to 8 days ahead
  promote: checking 1 day now
  promote: checking 2 days now
  promote: checking 3 days now
  promote: checking 4 days now
  promote: checking 5 days now
  promote: checking 6 days now
  promote: checking 7 days now
 promote: 
backup.pippo.it
://Servermti/backupz too big: new size
8908420 total 8908420, bal size 895396 thresh 44770
  promote: checking 8 days now
  promote: moving ctrl.pippo.it:/archivio up, total_lev0 45540,
total_size 976515
  promote: checking up to 8 days ahead
  promote: checking 1 day now
  promote: checking 2 days now
  promote: checking 3 days now
  promote: checking 4 days now
  promote: checking 5 days now
  promote: checking 6 days now
  promote: checking 7 days now
 promote: 
backup.pippo.it
://Servermti/backupz too big: new size
8908420 total 8953960, bal size 895396 thresh 44770
  promote: checking 8 days now
analysis took 0.003 secs
GENERATING SCHEDULE:
--------
backup.pippo.it
 //Servermti/backupz 2 1 2002:5:21:23:55:30 930847 2510
ctrl.pippo.it
 /archivio 2 0 1970:1:1:0:0:0 45540 5 1 2002:5:23:0:31:1
44210 4
--------
driver: adding holding disk 0 dir /space size 16384000
reserving 16384000 out of 16384000 for degraded-mode dumps
driver: start time 2700.486 inparallel 3 bandwidth 20000 diskspace
16384000 dir OBSOLETE datestamp 20020525 driver: drain-ends tapeq 
LFFO big-dumpers 0
driver: result time 2700.486 from taper: TAPER-OK
driver: send-cmd time 2700.486 to dumper0: FILE-DUMP 00-00001
/space/20020525/ctrl.pippo.it._archivio.0 
ctrl.pippo.it
 /archivio 0 
1970:1:1:0:0:0 1073741824 GNUTAR 45632 |;bsd-auth;
driver: send-cmd time 2700.486 to dumper1: FILE-DUMP 01-00002
/space/20020525/backup.pippo.it.__Servermti_backupz.1 
backup.pippo.it
 
//Servermti/backupz 1 2002:5:21:23:55:30 1073741824 GNUTAR 930912
|;bsd-auth;
driver: state time 2700.487 free kps: 10522 space: 15407456 taper:
idle idle-dumpers: 1 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 2700.487 if : free 10522
driver: hdisk-state time 2700.487 hdisk 0: free 15407456 dumpers 2
dumper: stream_client: connected to 192.168.0.11.43048
dumper: stream_client: our side is 0.0.0.0.32801
dumper: stream_client: connected to 192.168.0.11.43049
dumper: stream_client: our side is 0.0.0.0.32802
dumper: stream_client: connected to 192.168.0.28.32803
dumper: stream_client: our side is 0.0.0.0.32805
dumper: stream_client: connected to 192.168.0.28.32804
dumper: stream_client: our side is 0.0.0.0.32806
driver: result time 2706.468 from dumper0: DONE 00-00001 45540 45568 6
[sec 5.934 kb 45568 kps 7678.0 orig-kb 45540]
driver: finished-cmd time 2706.478 dumper0 dumped
ctrl.pippo.it:/archivio
driver: send-cmd time 2706.478 to taper: FILE-WRITE 00-00003
/space/20020525/ctrl.pippo.it._archivio.0 
ctrl.pippo.it
 /archivio 0
20020525
driver: state time 2706.478 free kps: 19630 space: 15407488 taper:
writing idle-dumpers: 2 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 2706.478 if : free 19630
driver: hdisk-state time 2706.478 hdisk 0: free 15407488 dumpers 1
taper: reader-side: got label MTI04 filenum 1
driver: result time 2744.901 from taper: DONE 00-00003 MTI04 1 [sec
38.420 kb 45600 kps 1186.9 {wr: writers 1425 rdwait 0.000 wrwait 
27.232 filemark 10.670}]
driver: finished-cmd time 2744.961 taper wrote ctrl.pippo.it:/archivio
driver: state time 2744.961 free kps: 19630 space: 15453088 taper:
idle idle-dumpers: 2 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 2744.961 if : free 19630
driver: hdisk-state time 2744.961 hdisk 0: free 15453088 dumpers 1
driver: result time 4516.707 from dumper1: RQ-MORE-DISK 01-00002
driver: send-cmd time 4516.717 to dumper1: CONTINUE
/space/20020525/backup.pippo.it.__Servermti_backupz.1 1073741824 46592
driver: state time 4516.718 free kps: 19630 space: 15406496 taper:
idle idle-dumpers: 2 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 4516.718 if : free 19630
driver: hdisk-state time 4516.718 hdisk 0: free 15406496 dumpers 1
driver: result time 4523.668 from dumper1: DONE 01-00002 931522 934240
1823 [sec 1823.023 kb 934240 kps 512.5 orig-kb 931522]
driver: finished-cmd time 4523.739 dumper1 dumped
backup.pippo.it
://Servermti/backupz
driver: send-cmd time 4523.739 to taper: FILE-WRITE 00-00004
/space/20020525/backup.pippo.it.__Servermti_backupz.1 
backup.pippo.it
 
//Servermti/backupz 1 20020525
driver: state time 4523.739 free kps: 20000 space: 15449728 taper:
writing idle-dumpers: 3 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 4523.739 if : free 20000
driver: hdisk-state time 4523.739 hdisk 0: free 15449728 dumpers 0
taper: reader-side: got label MTI04 filenum 2
driver: result time 5451.097 from taper: DONE 00-00004 MTI04 2 [sec
927.357 kb 934272 kps 1007.5 {wr: writers 29196 rdwait 0.000 wrwait 
911.006 filemark 9.901}]
driver: finished-cmd time 5451.317 taper wrote
backup.pippo.it
://Servermti/backupz
driver: state time 5451.317 free kps: 20000 space: 16384000 taper:
idle idle-dumpers: 3 qlen tapeq: 0 runq: 0 roomq: 0 wakeup: 86400 
driver-idle: not-idle
driver: interface-state time 5451.317 if : free 20000
driver: hdisk-state time 5451.317 hdisk 0: free 16384000 dumpers 0
driver: QUITTING time 5451.317 telling children to quit
driver: send-cmd time 5451.317 to dumper0: QUIT
driver: send-cmd time 5451.319 to dumper1: QUIT
driver: send-cmd time 5451.321 to dumper2: QUIT
driver: send-cmd time 5451.322 to taper: QUIT
taper: DONE [idle wait: 4485.225 secs]
taper: writing end marker. [MTI04 OK kb 979872 fm 2]
driver: FINISHED time 5454.074
amdump: end at Sat May 25 03:16:56 CEST 2002
--------------------------------------
e quello di log generale: 
---------------------------
START driver date 20020525
START planner date 20020525
START taper datestamp 20020525 label MTI04 tape 0
FAIL planner 
web.pippo.net
 /home 0 [Request to 
web.pippo.net
 timed
out.]
INFO planner Full dump of ctrl.pippo.it:/archivio promoted from 8 days
ahead.
FINISH planner date 20020525
STATS driver startup time 2700.485
STRANGE dumper 
ctrl.pippo.it
 /archivio 0 [sec 5.934 kb 45568 kps
7678.0 orig-kb 45540]
 sendbackup: start [ctrl.pippo.it:/archivio level 0]
 sendbackup: info BACKUP=/bin/tar
 sendbackup: info RECOVER_CMD=/bin/tar -f... -
 sendbackup: info end
 ? gtar: ./logs/firebox/fireboxlog: file changed as we read it
 | Total bytes written: 46632960 (44MB, 7.5MB/s)
 sendbackup: size 45540
 sendbackup: end
SUCCESS taper 
ctrl.pippo.it
 /archivio 20020525 0 [sec 38.420 kb 45600
kps 1186.9 {wr: writers 1425 rdwait 0.000 wrwait 27.232 filemark 
10.670}]
STRANGE dumper 
backup.pippo.it
 //Servermti/backupz 1 [sec 1823.023 kb
934240 kps 512.5 orig-kb 931522]
 sendbackup: start [
backup.pippo.it
://Servermti/backupz level 1]
 sendbackup: info BACKUP=/usr/bin/smbclient
 sendbackup: info RECOVER_CMD=/usr/bin/smbclient -f... -
 sendbackup: info end
 ? tdb((null)): tdb_open_ex: could not open file
/var/run/samba/unexpected.tdb: No such file or directory
 ? tdb((null)): tdb_open_ex: could not open file
/var/run/samba/unexpected.tdb: No such file or directory
 ? tdb((null)): tdb_open_ex: could not open file
/var/run/samba/unexpected.tdb: No such file or directory
 ? NT_STATUS_ACCESS_DENIED listing
\RECYCLER\S-1-5-21-583907252-436374069-1060284298-500\*
 ? NT_STATUS_ACCESS_DENIED listing \System Volume Information\*
 | tar: dumped 5509 files and directories
 | Total bytes written: 953878016
 sendbackup: size 931522
 sendbackup: end
SUCCESS taper 
backup.pippo.it
 //Servermti/backupz 20020525 1 [sec
927.357 kb 934272 kps 1007.5 {wr: writers 29196 rdwait 0.000 wrwait 
911.006 filemark 9.901}]
INFO taper tape MTI04 kb 979872 fm 2 [OK]
FINISH driver date 20020525 time 5454.074
----------------------------------
Sapete dirmi qualcosa sul come uscirne?
Grazie 1000 :)
Ciao

Un problema l'ho risolto (sono cieco, non ho visto che stava lavorando
in level 1 al posto di level 0), e quindi una buona parte dei problemi
è stata risolta, resta però il problema del timeout. In mezzo ai due
c'è solo un routerino che si limita a smistare i pacchetti verso una o
l'altra rete senza bloccare nulla (no firewall) e quindi io non so
proprio cosa sia che lo faccia andare in timeout.... idee?
Bye