Re: Update on fossil repositories

[bch%methodlogic.net@localhost]

On Wed, Mar 30, 2011 at 11:45:25PM +0200, Joerg Sonnenberger wrote:
> On Wed, Mar 30, 2011 at 08:46:34PM +0000, bch%methodlogic.net@localhost wrote:
> > On Wed, Mar 30, 2011 at 05:58:57PM +0200, Joerg Sonnenberger wrote:
> > > Hi all,
> > > I've recently updated the hardware on the machine I am using the for
> > > fossil conversion runs to include a SSD. This has dramatically speed up
> > > the process and I now expect the fossil repo to be up-to-date with a
> > > window of 2-3 hours.
> > > 
> > > The NetBSD src tree can be found at http://netbsd.sonnenberger.org, a
> > > copy to speed up the cloning and help save my bandwidth can be found at
> > > http://ftp.NetBSD.org/pub/NetBSD/misc/repositories/fossil/src.fossil.
> > > This file has a size of ~2.4GB.
> > > 
> > > The pkgsrc tree can be found at http://pkgsrc.sonnenberger.org, the
> > > plain repo at
> > > http://ftp.NetBSD.org/pub/NetBSD/misc/repositories/fossil/pkgsrc.fossil.
> > > Note that this is a fresh trace and uses a different project id than the
> > > earlier copy. This file has a size of ~610MB.
> > 
> > Hi Joerg.  Has this been constructed w/ delta manifests? Lack of delta
> > manifests on the previous version made for extremely expensive rebuilds.
> 
> I think the old version already used delta manifests. This is using the
> result of rebuild --compress too. Rebuilds are still expensive, mostly
> due to the large size. I am considerating doing some profiling to see if
> they can be made cheaper, but there are bigger fishes to fry.

re: bigger fish: acknowledged and understood.

I think the prev pkgsrc version was *not* delta manifest'd though... the
repo is ~588M, 60935 files, versus netbsd-src's 3.2G, 127280
files... rebuilding pkgsrc too ~6x as long as netbsd-src, iirc.

-bch

-- 
Brad Harder
Method Logic Digital Consulting
http://methodlogic.net/
http://twitter.com/bcharder