Fwd:[cvsnt] Re: Performance problem with large f iles

[michel.leclerc at b-rail.be]

Tony,

It seems that network speed is not the bottleneck. I've tried with a speed of
10 Mbits, 100Mbits and gigabit and it does not make a big difference.
These large files are binary files and I don't understand why they require so
much CPU resources. Why CVs does require so much memory to handle these files?
Which amount of memory do I need to feel comfortable?

Thanks for your Help

Michel Leclerc


Tony Hoyle  (21/10/2004  15:37):
>michel.leclerc at b-rail.be wrote:
>> Hello,
>>
>> I need to store large files (more than 200 MB) into the repository.
>> Checkout for theses files takes a very very long time (approx 1 hour for 270
>> MB).
>> Is there a solution to this performance problem
>>
>You're probably running out of memory on the server.  That'll slow it
>down.    You also need a beefy CPU to process a file that big.
>
>Make sure your ethernet is running at at least 100MB (preferably gigabit
>if you're shifting files that big regularly) as any network delay on a
>file that big will be significant.
>
>You should be able to get it down to about 20-30 minutes, but really
>version control systems aren't designed for things that big - they have
>to process the file to store it, and any processing rapidly builds up -
>a checkout of the HEAD revision is pretty efficient and is going be
>within usability.  A checkout of a non-HEAD revision is going to take
>much longer.
>
>Tony
>
>_______________________________________________
>cvsnt mailing list
>cvsnt at cvsnt.org
>http://www.cvsnt.org/cgi-bin/mailman/listinfo/cvsnt


_________________________________________________________________
Leclerc Michel                      SNCB-NMBS     Information Technology
Ing (Analyste fonctionnel)                                       I CT 501
142 Rue Bara
TEL:  02/ 525.29.61       02/525.46.57                         1060 Bruxelles

E-Mail: michel.leclerc at B-RAIL.BE <mailto:michel.leclerc at B-RAIL.BE>

Ce qui se conçoit bien s'énonce clairement et les mots pour le dire arrivent
aisément.