I'm tired of this!  I'm going

          darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc

on Windows.

Most times I try this, it starts out looking good, and then hangs indefinitely, consuming no CPU:

bash-3.1$ darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc
Copying pristine 53 done, 54 queued. Var.lhs
Copying pristine 65 done, 85 queued. CmmCPSZ.hs
Copying pristine 79 done, 71 queued. CmmProcPointZ.hs
Copying pristine 97 done, 53 queued. ZipCfgCmmRep.hs
Copying pristine 112 done, 82 queued. CgForeignCall.hs
Copying pristine 114 done, 80 queued. CgHpc.hs
Copying pristine 135 done, 59 queued. StgCmmExpr.hs
Copying pristine 139 done, 55 queued. StgCmmHpc.hs
Copying pristine 141 done, 53 queued. StgCmmMonad.hs
Copying pristine 147 done, 61 queued. CoreArity.lhs
Copying pristine 148 done, 60 queued. CoreFVs.lhs


Sometimes it gets hash failures

bash-3.1$ darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc
Copying pristine 18 done, 28 queued. ghc.mk
Copying pristine 26 done, 56 queued. Makefile
Copying pristine 38 done, 69 queued. Literal.lhs
Copying pristine 51 done, 56 queued. UniqSupply.lhs
Copying pristine 79 done, 71 queued. CmmProcPointZ.hs
Copying pristine 167 done, 59 queued. DsBinds.lhs
Copying pristine 171 done, 55 queued. DsForeign.lhs
Copying pristine 175 done, 51 queued. DsMonad.lhs
Copying pristine 177 done, 49 queued. Match.lhs
Copying pristine 181 done, 45 queued. ghc.cabal.in
Copying pristine 183 done, 43 queued. ghci
Copying pristine 184 done, 55 queued. ByteCodeAsm.lhs
Copying pristine 186 done, 53 queued. ByteCodeGen.lhs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000011933-789ab0a296e174cde2e5a63f552d4b2ceca8cb27beb894369a13741e306f7312
Copying pristine 188 done, 51 queued. ByteCodeItbls.lhs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000010399-7610f894f0c70f2d85d0ed2b23ef788787e690ed4e7572dbe4e722dc6e8d54d4
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000009170-843d297ca8894feb7275a1fb94f8bab1a430e2653b262d6fd2b464696abcbd3f
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000004592-5b832f01a963645a88dba894a618861b76e99a4d85b254c9e48df5ce559d1d7c
Copying pristine 193 done, 46 queued. Linker.lhs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000045804-9bf89c140778ebef6d6da6f7d6ee9ad8cefc396d455d90ab4f0b3def50aebeef
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000003548-075b75cec73df4d7d52800c43c54f021ac68b61d93215fd2a5704926cb47f0eb
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000051537-bfd15515848a1d1db16b38aff694036fe332873b68c66ede976238b0097308a4
Copying pristine 197 done, 42 queued. hsSyn
Copying pristine 198 done, 54 queued. Convert.lhs
  C-c C-cCouldn't handle interrupt since darcs was in a sensitive job.
Copying pristine 199 done, 53 queued. HsBinds.lhs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000026861-3cc8049938a66c58be970041e8f7b92e8482232d838ff51d5289b56ba246da83
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000037321-c53fe12dcbb6eebce2863f4d032d4c26592e23ec7412ea6663d682c3dd6a2719
Copying pristine 201 done, 51 queued. HsDoc.hs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000049333-166b49fb9f4ae78fb0dd5cacb1e353ffc6ad1a66d5dc0e366d6bb06e7130951c
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000016976-6a76535d752c883cd098c33214443311ed173a4b328f258b6f67893700622bac
Copying pristine 210 done, 42 queued. HsUtils.lhs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000024807-059b3b91e957e227a6a3307266c84970348f98fdfbe43f2bbb1a0d242e6b4f48
Copying pristine 212 done, 49 queued. BinIface.hs
Copying pristine 213 done, 48 queued. BuildTyCl.lhs

(then it hung)
... I killed it at this point....


The behaviour differs each time.  After ten tries, all failed, I've given up.

I have a wired connection.

I am using Darcs 2.4.4.  I can't find a binary Darcs 2.5 for Windows.

Simon

Attachments

• unnamed

On Fri, Nov 19, 2010 at 20:13:19 +0000, Simon Peyton-Jones wrote:
> I'm tired of this!  I'm going
> 
>           darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc

:-(

> on Windows.
> 
> Most times I try this, it starts out looking good, and then hangs indefinitely, consuming no CPU:

Let me see if I can find somebody else on Windows to help reproduce
this (works for me with my darcs 2.5+ on a Mac).

What could help is darcs get --lazy --no-cache --debug --debug-http

This will produce lots of logs

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

On Fri, Nov 19, 2010 at 20:16:43 +0000, Eric Kow wrote:
> What could help is darcs get --lazy --no-cache --debug --debug-http

Another potentially useful debugging step (and workaround)
is to fetch over SSH

Does that work?

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

Ha ha. Needless to say, adding the debug flags makes it work!  I'll try a couple more times.

(Meanwhile I used a tarball so i'm not stuck)


|  -----Original Message-----
|  From: Eric Kow [mailto:bugs@darcs.net]
|  Sent: 19 November 2010 20:31
|  To: dmitry.kurochkin@gmail.com; Simon Peyton-Jones
|  Subject: [issue2000] darcs get fails
|  
|  
|  Eric Kow <kowey@darcs.net> added the comment:
|  
|  On Fri, Nov 19, 2010 at 20:16:43 +0000, Eric Kow wrote:
|  > What could help is darcs get --lazy --no-cache --debug --debug-http
|  
|  Another potentially useful debugging step (and workaround)
|  is to fetch over SSH
|  
|  Does that work?
|  
|  --
|  Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
|  For a faster response, try +44 (0)1273 64 2905 or
|  xmpp:kowey@jabber.fr (Jabber or Google Talk only)
|  
|  __________________________________
|  Darcs bug tracker <bugs@darcs.net>
|  <http://bugs.darcs.net/issue2000>
|  __________________________________

On Fri, Nov 19, 2010 at 20:39:39 +0000, Simon Peyton-Jones wrote:
> Ha ha. Needless to say, adding the debug flags makes it work!  I'll try a couple more times.

Argh :-)

One thing would be to try with just --no-cache sans debug flags

Also: if you could give us your darcs --exact-version it could
help.  I'm wondering if you're using a curl-enabled darcs or
one built against the HTTP library.

PS. congratulations on the dubious honour of reporting our 2000th bug!

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

|  One thing would be to try with just --no-cache sans debug flags

Interesting.  Using --no-cache works, and works reliably, twice in a row.

On the other hand, leaving out --no-cache fails reliably with 

bash-3.1$ darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc
Copying pristine 1 done, 38 queued. .authorspellings
Copying pristine 20 done, 26 queued. boot-pkgs
Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
Copying pristine 35 done, 72 queued. Id.lhs
Copying pristine 45 done, 62 queued. NameEnv.lhs

On Mon, Nov 22, 2010 at 12:33:08 +0000, Simon Peyton-Jones wrote:
> bash-3.1$ darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc
> Copying pristine 1 done, 38 queued. .authorspellings
> Copying pristine 20 done, 26 queued. boot-pkgs
> Hash failure in http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
> Copying pristine 35 done, 72 queued. Id.lhs
> Copying pristine 45 done, 62 queued. NameEnv.lhs

Maybe something snuck into your cache during one of your problematic
downloads (issue2002 - bad files should not "sneak in" like that).

Two things that would help our debugging when you have time

1. We would like to know what your
     0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
   contains.  Is it empty? Is mismatching in some other way?

   For example, to look at the original, I did this

      wget http://darcs.haskell.org/ghc-new-co-17Nov10/ghc/_darcs/pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
      zcat 0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab | sha256sum

   Could you examine and/or upload your copy?  I think it may live in
      UserProfile%\Application Data\darcs\cache\pristine

2. What happens if we move away your global cache?  It could be good to
   hang on to it in case it helps for forensics later.

   I think your cache lives here:
     UserProfile%\Application Data\darcs\cache

   If whatever intermittent (?) failure has gone away such that you
   can reliably fetch with --no-cache, I think this means that doing
   darcs get a second time will also work reliably since it'll just be
   using the cache (with good contents)

   [There's also a 1.5 variant of this step which includes just moving
   away the offending file, but I don't know how many of these there
   are, and I don't want to use up your time]

Finally, there is now a darcs-2.5 binary on http://wiki.darcs.net/Binaries
Maybe it's worth trying once we're a bit clearer about what's going on
with your cache.

Sorry about this!

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

| 1. We would like to know what your
|      0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
|    contains.  Is it empty? Is mismatching in some other way?
| 
|    For example, to look at the original, I did this
| 
|       wget http://darcs.haskell.org/ghc-new-co-
| 17Nov10/ghc/_darcs/pristine.hashed/0000003387-
| bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
|       zcat 0000003387-
| bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab | sha256sum
| 
|    Could you examine and/or upload your copy?  I think it may live in
|       UserProfile%\Application Data\darcs\cache\pristine

That directory doesn't seem to exist.  Indeed "Application Data" has no darcs sub-directory. Can I ask darcs where it keeps its cache?

Thanks for following this up.  I do seem to be an unusually troublesome Darcs user!

Simon

On Wed, Nov 24, 2010 at 09:20:29 +0000, Simon Peyton-Jones wrote:
> That directory doesn't seem to exist.  Indeed "Application Data" has
> no darcs sub-directory. Can I ask darcs where it keeps its cache?

Whoops, sorry about this!  You may have just helped me spot a
documentation bug (inconsistent docs on Windows paths).

Hopefully that path I gave you was simply just wrong because it
wasn't the same as your %APPDATA% environment variable.  If it
actually was your %APPDATA% then I'm stumped.

Does darcs show repo tell you where the cache is?  It does point
to my global cache when I go into any of my repositories and run
it.

> Thanks for following this up.  I do seem to be an unusually troublesome Darcs user!
> 
> Simon
> 
> __________________________________
> Darcs bug tracker <bugs@darcs.net>
> <http://bugs.darcs.net/issue2000>
> __________________________________
> _______________________________________________
> darcs-devel mailing list
> darcs-devel@darcs.net
> http://lists.osuosl.org/mailman/listinfo/darcs-devel
> 

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

|  Whoops, sorry about this!  You may have just helped me spot a documentation bug
|  (inconsistent docs on Windows paths).
|  
|  Hopefully that path I gave you was simply just wrong because it wasn't the same as
|  your %APPDATA% environment variable.  If it actually was your %APPDATA% then
|  I'm stumped.

It turned out that %APPDATA% was APPDATA=C:\Users\simonpj\AppData\Roaming

|  Does darcs show repo tell you where the cache is?  It does point to my global cache
|  when I go into any of my repositories and run it.

So I say "darcs --show-cache-path" or what?

Anyway scatted the file you wanted. It is below, along with the sha256sum thing you asked for.

Simon


bash-3.1$ cd C:/Users/simonpj/AppData/Roaming/darcs/cache
bash-3.1$ zcat pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab
file:
DEPEND-NOTES
0000000103-23543fe14ec303194e3ace7ebf18409cc2160240033dc10005e202461cba5102
file:
DLL-NOTES
0000002431-d23ab688bc492686587e82296ef3ce94f7a3821c5d37a086553595f21e4bf1aa
file:
HsVersions.h
0000003535-8a57113cf57fd62a5cbf94fdbaaa8aba16971e2b8b2df71ad8075ab9f8a069a8
file:
LICENSE
0000001611-e06c13b8a117652621781c15d622bd4c62c568307954f7136955b4b656d14ec1
file:
Makefile
0000001413-a349ff193a5cf3b6c5eba96f7f1011f9cba8a9585e262ea0a18cfc20f6436ce1
file:
Makefile.local
0000003860-8780a2149f1f8700f4f53737721ca2338b9a0c0da641f6e3576f7d05b5075c7a
file:
NOTES
0000004603-b707fbeb797b0a3f524f8b38094a05a45c0efa871084d2d896b669ba599a8564
file:
Simon-log
0000045512-1227996f1fd29220b5a6a50d155df1eeecf4c5b207d9798cae97b71ff72920bc
directory:
basicTypes
0000002356-8e4fe92f19d24a3bf2976c801b7561bd1ee8a2255d468495cd3281cda4178811
directory:
cbits
0000000000-e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855
directory:
cmm
0000004090-c650264425f9d785644f7d3ac61e2ebef8dc186563a1964440aafc64bf36b3ca
directory:
codeGen
0000004218-522bebe16e1584f0061e3c860b109cbc0ccc33852c4b3af19df37f117108399a
directory:
coreSyn
0000001347-f4262076ad77baebe1b0fd614cb1a05e00abc1ea618cc839aca36e5054758185
file:
count_bytes
0000000943-e292b5a2d085c32fc108ae342d17b7d37361c12fd2b88142db32eb4b4a2545eb
directory:
deSugar
0000001701-972bd3c67abd764604a3a4b00e5b1b262bb058c9a6ee15bc01b78412eb51a855
file:
ghc.cabal.in
0000012429-6606c36edb83e3dec0ecabce854738b9c21b9a32c819f46a74a9c10386762dba
file:
ghc.mk
0000025780-cffe3be1451182e4b256611f9f254dfc9ddd39b3f91f6c35119e01df3848dc17
directory:
ghci
0000001273-f4fa0dcc1ca5c7e184d6122fb0c37297ee9eb907c6d441a84fba0a1fdfe608ab
directory:
hsSyn
0000001220-7f4652afea35e5262f9df2f1dc77bed912f294a809bdc62e3c304de5643ce07d
directory:
iface
0000000859-8306d61a180fdb4f0c256a5e4c4aa63de7a9001c0467bf527b12b321c87226dc
directory:
llvmGen
0000000475-6a8361a3d43d65ac3360e83bca014f15fefcbeff9b55f286ad80b61f44109217
directory:
main
0000002714-83210911fc678bf86c1377e27ff93d186edf5526dd9ba8aa1809152260ce7cab
directory:
nativeGen
0000001572-0777d36da44e07583ad0c97dc3553866944bac841b15d64b0b6a1494bf59e4f8
directory:
parser
0000000940-1c1e788dfcc7d2a0e66112ce7eab1d1d4b81109b1a59449b357dedec33b5f69f
directory:
prelude
0000000766-4488b9f5ff5a347229a7a01328a80e90c407c39ebd43e38139e81ca2a5064fc9
directory:
profiling
0000000280-a12fe6afab75df1002d452b99b7d4d16e5cbebaf99fe8c11a17fca398bb4dfaf
directory:
rename
0000001032-5b6d5249cdb476a0dae74d9aa99100c8c417a49ae65564cdf80196cf2562171c
directory:
simplCore
0000001333-703c5012b1571c26949c0892eddebddc73faf38f7e3d258b0a94e5de2e5bf667
directory:
simplStg
0000000280-25bf5e9d0356e236010df867462cbef1c252d6144c60515f3cfbf8a25efdfc85
directory:
specialise
0000000286-f76391e21cb66208c27b6825d6b389015e16cd2db24d1aa5130152aaa3d1341d
directory:
stgSyn
0000000283-313d340ed10e3cb7a3ee5558c648427bc6eafe198cebe4ce88ec9e8f1fa93538
directory:
stranal
0000000281-a2d3759d8aed744c97af7b50a43e750919d0f4cb7f886e5df1b8bf16c20fdf3c
directory:
typecheck
0000003845-925ea0f76543c50b9a8af21908e0441a66d9cf29876eb97dfdf185cbffb2362f
directory:
types
0000001230-1bf5dabbe5ab092c7cdeb6b3ed1efa3072bfb9b5ae12dd4bd1959713d8bfe8fd
directory:
utils
0000003295-29c3cc0bc5b6dc5d9151dd7f2d1220be11858b1df00a5028ec7112f3da8a4c96
directory:
vectorise
0000000192-ab5161493b937d0c0b2d44719ee875b7e96d179a0ce10a691124349bb85c1cf6


bash-3.1$ zcat pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab  | sha256sum
bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab *-
bash-3.1$

On Thu, Nov 25, 2010 at 16:41:56 +0000, Simon Peyton-Jones wrote:
> It turned out that %APPDATA% was APPDATA=C:\Users\simonpj\AppData\Roaming

OK good, so that explains it.  I've pushed a patch which I hope nails
down all the remaining references to Windows paths in the doc, making
them all use %APPDATA% where relevant.

> |  Does darcs show repo tell you where the cache is?  It does point to my global cache
> |  when I go into any of my repositories and run it.
> 
> So I say "darcs --show-cache-path" or what?

That would have been just

  darcs show repo

> Anyway scatted the file you wanted. It is below, along with the sha256sum thing you asked for.

Thanks!

> bash-3.1$ zcat pristine.hashed/0000003387-bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab  | sha256sum
> bb9343fc605f3c8585cb66d9e7e70e346d6de7e75efb58469b68dc7eb23c98ab *-

Err, interesting that it seems to have the correct value.  We (darcs)
will probably need to go away for a while and figure out what debugging
steps to minimise the number of iterations we put you through
unnecessarily.  It might be useful if you could freeze a copy of that
global cache directory for posterity, it might be useful.

-- 
Eric Kow <http://www.nltg.brighton.ac.uk/home/Eric.Kow>
For a faster response, try +44 (0)1273 64 2905 or
xmpp:kowey@jabber.fr (Jabber or Google Talk only)

| Err, interesting that it seems to have the correct value.  We (darcs) will probably
| need to go away for a while and figure out what debugging steps to minimise the
| number of iterations we put you through unnecessarily.  It might be useful if you
| could freeze a copy of that global cache directory for posterity, it might be useful.

ok

I just tested this on Windows Vista. The command finished without any trouble in reasonable time (couple minutes).

PS D:\darcs\tests> cd 2000
PS D:\darcs\tests\2000> darcs get --lazy http://darcs.haskell.org/ghc-new-co-17Nov10/ghc
Finished getting.
PS D:\darcs\tests\2000> ls


    Directory: D:\darcs\tests\2000


Mode                LastWriteTime     Length Name
----                -------------     ------ ----
d----        2012-02-10     01:28            ghc


PS D:\darcs\tests\2000> darcs --exact-version
darcs compiled on Mar 14 2011, at 23:17:58

Context:

[TAG 2.5.2
Ganesh Sittampalam <ganesh@earth.li>**20110313223504
 Ignore-this: f3f57f3eacb2fdd4cdafc581c05058e3
]

Compiled with:

HTTP-4000.0.9
array-0.3.0.1
base-4.2.0.2
bytestring-0.9.1.7
containers-0.3.0.0
directory-1.0.1.1
extensible-exceptions-0.1.1.1
filepath-1.1.0.4
hashed-storage-0.5.5
haskeline-0.6.3.2
html-1.0.1.2
mtl-1.1.0.2
network-2.2.1.7
old-time-1.0.0.5
parsec-2.1.0.1
process-1.0.1.3
random-1.0.0.2
regex-compat-0.93.1
regex-posix-0.94.4
tar-0.3.1.0
text-0.11.0.5
unix-compat-0.2.1.1
zlib-0.5.2.0
PS D:\darcs\tests\2000>

Due to the age of this ticket and the last message, I'm making this as 
given-up.