darcs

Issue 756 darcs get --to-match "hash foo" uses excessive memory for large repos

Title darcs get --to-match "hash foo" uses excessive memory for large repos
Priority bug Status duplicate
Milestone Resolved in
Superseder Nosy List darcs-devel, dmitry.kurochkin, kowey, thorkilnaur, tommy, tux_rocker, vmiklos
Assigned To
Topics

Created on 2008-03-22.02:52:46 by vmiklos, last changed 2009-08-27.13:57:00 by admin.

Messages
msg3956 (view) Author: vmiklos Date: 2008-03-22.02:52:45
how to reproduce:

$ darcs get http://ftp.frugalware.org/pub/archive/other/darcs/frugalware-current/
$ darcs get --to-match "hash 20050127214749-3bee8-696de7886abbb1b27960790a414aaeb138f7206b.gz" frugalware-current tmp
darcs: failed to read patch in get_extra:
Sun Jan 14 04:08:03 UTC 2007  crazy <crazy@frugalware.org>
  * ndiswrapper-1.34-1-i686
  * Version bump
Perhaps this is a 'partial' repository?

'ndiswrapper-1.34-1-i686' is
20070114040803-f6986-0b0716f3dbe5ab62512842837a38a2bb741927d5.gz, you
can check it yourself.

$ ls frugalware-current/_darcs/patches/20070114040803-f6986-0b0716f3dbe5ab62512842837a38a2bb741927d5.gz
frugalware-current/_darcs/patches/20070114040803-f6986-0b0716f3dbe5ab62512842837a38a2bb741927d5.gz

so it seem to be there.

thanks
msg3958 (view) Author: tux_rocker Date: 2008-03-22.10:24:48
Duplicate of 755
msg3960 (view) Author: vmiklos Date: 2008-03-22.12:00:11
yes. quite strange, as i'm sure i sent only _one_ mail to bugs@darcs.net :S

please close this bug.

thanks
msg3965 (view) Author: droundy Date: 2008-03-22.16:50:02
On Sat, Mar 22, 2008 at 02:52:46AM -0000, VMiklos wrote:
> how to reproduce:
> 
> $ darcs get http://ftp.frugalware.org/pub/archive/other/darcs/frugalware-current/
> $ darcs get --to-match "hash 20050127214749-3bee8-696de7886abbb1b27960790a414aaeb138f7206b.gz" frugalware-current tmp
> darcs: failed to read patch in get_extra:
> Sun Jan 14 04:08:03 UTC 2007  crazy <crazy@frugalware.org>
>   * ndiswrapper-1.34-1-i686
>   * Version bump
> Perhaps this is a 'partial' repository?

I wonder if this might be a running-out-of-memory bug? This succeeds on my
computer (although it's pretty slow).  Any chance you could keep an eye on
top while running this? Is your computer running 32 bit darcs or 64 bit
darcs?

David

P.S. Thanks for the bug report!
msg3966 (view) Author: vmiklos Date: 2008-03-22.17:00:19
On Sat, Mar 22, 2008 at 04:50:05PM -0000, David Roundy <bugs@darcs.net> wrote:
> I wonder if this might be a running-out-of-memory bug? This succeeds on my
> computer (although it's pretty slow).  Any chance you could keep an eye on
> top while running this? Is your computer running 32 bit darcs or 64 bit
> darcs?

18714 vmiklos   20   0 30488  24m 2864 R 82.6  2.4   0:20.65 darcs

so it does not eat more than 24mb of memory, shile eating 82% of the cpu
(pretty normal).

this is a 32 bit darcs. did you try on a 64bit machine?
msg3969 (view) Author: droundy Date: 2008-03-22.17:24:43
On Sat, Mar 22, 2008 at 05:00:20PM -0000, Miklos Vajna wrote:
> On Sat, Mar 22, 2008 at 04:50:05PM -0000, David Roundy <bugs@darcs.net> wrote:
> > I wonder if this might be a running-out-of-memory bug? This succeeds on my
> > computer (although it's pretty slow).  Any chance you could keep an eye on
> > top while running this? Is your computer running 32 bit darcs or 64 bit
> > darcs?
> 
> 18714 vmiklos   20   0 30488  24m 2864 R 82.6  2.4   0:20.65 darcs
> 
> so it does not eat more than 24mb of memory, shile eating 82% of the cpu
> (pretty normal).
> 
> this is a 32 bit darcs. did you try on a 64bit machine?

Yeah, and right now it's using 2.5 gig of memory, so I think it's say to
say that this is a memory-consumption bug.
-- 
David Roundy
Department of Physics
Oregon State University
History
Date User Action Args
2008-03-22 02:52:46vmikloscreate
2008-03-22 10:24:49tux_rockersetpriority: bug
nosy: + tux_rocker
status: unread -> unknown
messages: + msg3958
2008-03-22 10:25:08tux_rockersetstatus: unknown -> duplicate
nosy: tommy, beschmi, kowey, vmiklos, tux_rocker
2008-03-22 12:00:12vmiklossetnosy: tommy, beschmi, kowey, vmiklos, tux_rocker
messages: + msg3960
2008-03-22 16:50:04droundysetnosy: + droundy
messages: + msg3965
2008-03-22 17:00:20vmiklossetnosy: droundy, tommy, beschmi, kowey, vmiklos, tux_rocker
messages: + msg3966
2008-03-22 17:24:44droundysetnosy: droundy, tommy, beschmi, kowey, vmiklos, tux_rocker
messages: + msg3969
title: darcs get --to-match "hash foo" broken for large repos -> darcs get --to-match "hash foo" uses excessive memory for large repos
2009-08-06 17:57:10adminsetnosy: + markstos, jast, Serware, dmitry.kurochkin, darcs-devel, zooko, dagit, mornfall, simon, thorkilnaur, - droundy, vmiklos, tux_rocker
2009-08-06 21:00:52adminsetnosy: - beschmi
2009-08-10 22:18:32adminsetnosy: + vmiklos, tux_rocker, - markstos, darcs-devel, zooko, jast, dagit, Serware, mornfall
2009-08-25 18:07:55adminsetnosy: + darcs-devel, - simon
2009-08-27 13:57:00adminsetnosy: tommy, kowey, vmiklos, darcs-devel, thorkilnaur, tux_rocker, dmitry.kurochkin