darcs

Issue 2730 Pushing consumes too much memory

Title Pushing consumes too much memory
Priority Status unknown
Milestone Resolved in
Superseder Nosy List alexdarcy, simon
Assigned To
Topics

Created on 2024-08-18.13:41:42 by alexdarcy, last changed 2024-08-19.09:32:43 by ganesh.

Messages
msg24075 (view) Author: alexdarcy Date: 2024-08-18.13:41:39
1. Summarise the issue (what were doing, what went wrong?)
Pushing alexdarcy/org-test leads to disproportionate RAM usage. It crashes my computer (16Gb RAM) and Simon had to kill it after 20Gb.
It can be reproduced by cloning and pushing it to hub.darcs.net.
 
This repo has been imported from git with git fast-export --all --progress 500 | darcs convert import.

Its size is 712M of which 649M is _darcs; it contains 1367 patches including many multi-megabyte patches.

2. What behaviour were you expecting instead?
Consume a reasonable RAM amount !

3. What darcs version are you using? (Try: darcs --exact-version)
2.18.3 (GHC 9.2.8)
Simon reproduces the issue with darcs 2.16 (ghc 8.10.7) and darcs 2.18.3 (ghc 9.8.2)

4. What operating system are you running?
 Gentoo
msg24076 (view) Author: ganesh Date: 2024-08-19.09:32:40
Some quick notes from investigating a little bit:

I tried it locally (push from this repo to an empty repo) and the
darcs process peaked at about 11G.

A workaround is to push in smaller chunks but obviously we should
be able to do better.

I guess that this has come up before but I haven't looked for tickets.
History
Date User Action Args
2024-08-18 13:41:42alexdarcycreate
2024-08-18 18:07:46simonsetnosy: + simon
2024-08-19 09:32:43ganeshsetmessages: + msg24076