Subject: Re: pkg/15501: rsync development branch causes corruption with alpha server
To: Manuel Bouyer <bouyer@antioche.eu.org>
From: Greg A. Woods <woods@weird.com>
List: netbsd-bugs
Date: 02/26/2002 20:09:30
[ On Tuesday, February 26, 2002 at 19:48:10 (+0100), Manuel Bouyer wrote: ]
> Subject: Re: pkg/15501: rsync development branch causes corruption with alpha server
>
> On Tue, Feb 26, 2002 at 04:08:59AM -0500, Greg A. Woods wrote:
> > Any idea yet on when rsync.netbsd.org might have an updated and
> > un-corrupted copy of the CVS repository again?
>
> As far as I know anoncvs is ok now.
I don't know anythin about the current stat of anoncvs -- I'm asking
about rsync, which definitely is not OK yet.
> Did you try 'rsync -c -W' ?
Hmmm.... '-c' isn't going to be very friendly to the server, but I guess
I can try it once:
-c, --checksum
This forces the sender to checksum all files using
a 128-bit MD4 checksum before transfer. The check-
sum is then explicitly checked on the receiver and
any files of the same name which already exist and
have the same checksum and size on the receiver are
skipped. This option can be quite slow.
Note that '-W' cannot do anything if there is no need to transfer any
files in the first place:
-W, --whole-file
With this option the incremental rsync algorithm is
not used and the whole file is sent as-is instead.
The transfer may be faster if this option is used
when the bandwidth between the source and target
machines is higher than the bandwidth to disk
(especially when the "disk" is actually a networked
file system). This is the default when both the
source and target are on the local machine.
(and yes, I've confirmed this as much as I can with the rsync source,
though there is some small room for error in my reading of this rather
complex code).
Note also that rsync.netbsd.org still fails Alan's test (see his reply
in the PR database) even with '-c':
$ rsync -v -c -W rsync://rsync.netbsd.org/anoncvs/main/pkgsrc/mk/bsd.pkg.defaults.mk,v /tmp/foo,v
/tmp/foo,v
wrote 119 bytes read 91924 bytes 26298.00 bytes/sec
total size is 91784 speedup is 1.00
$ rlog /tmp/foo,v > /dev/null
rlog: /tmp/foo,v:189: missing 'author' keyword
rlog aborted
$
As does rsync.jp.netbsd.org too:
$ rm -f /tmp/foo,v
$ rsync -v -c -W rsync://rsync.jp.netbsd.org/anoncvs/main/pkgsrc/mk/bsd.pkg.defaults.mk,v /tmp/foo,v
/tmp/foo,v
wrote 119 bytes read 84722 bytes 13052.46 bytes/sec
total size is 84582 speedup is 1.00
$ rlog /tmp/foo,v > /dev/null
rlog: /tmp/foo,v:49: missing date
rlog aborted
$
Hmmm.... corrupted, but differently! (well it is a different size too)
> Can you try to rsync from anoncvs.fr.netbsd.org and tell us how it goes ?
First let's try to run Alan's test, with '-c', with that sever too.
$ rm -f /tmp/foo,v
$ rsync -v -c -W rsync://rsync.fr.netbsd.org/anoncvs/main/pkgsrc/mk/bsd.pkg.defaults.mk,v /tmp/foo,v
@ERROR: Unknown module 'anoncvs'
rsync: connection unexpectedly closed (45 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(140)
$
oops -- maybe not.....
What's the correct incantation for rsync.fr, and why would it be different?
There's no hint that it should be different in the mirrors docs:
<URL:http://www.netbsd.org/mirrors/#rsync>
I get no luck with finding the CVS repo on rsync://archive.progeny.com/
either..... From what I can tell from remote it seems there is no copy
of the CVS repo on archive.progeny.com, even though they claim 58 GB of
NetBSD-related stuff is there.
--
Greg A. Woods
+1 416 218-0098; <gwoods@acm.org>; <g.a.woods@ieee.org>; <woods@robohack.ca>
Planix, Inc. <woods@planix.com>; VE3TCP; Secrets of the Weird <woods@weird.com>