darcs

Issue 2165 darcs-benchmark: investigate criterion integration?

Title darcs-benchmark: investigate criterion integration?
Priority feature Status needs-diagnosis/design
Milestone Resolved in
Superseder Nosy List kowey
Assigned To
Topics DarcsBenchmark

Created on 2012-04-01.11:15:40 by kowey, last changed 2012-04-01.11:47:24 by kowey.

Messages
msg15475 (view) Author: kowey Date: 2012-04-01.11:15:36
(Importing from bugs-everywhere)

Can criterion help us to figure out if our benchmarks have any kind of 
validity from a statistical point of view?
msg15483 (view) Author: kowey Date: 2012-04-01.11:47:23
Comments from the bug-tracker

This could even lead to criterion/progression integration where we feed
this cached-on-disk data to the libraries.

The idea is to accumulate enough data over the long run (say over several
months) to do statistically interesting things.  Every time you run dars-
benchmark,
we squirrel away some new data in our archives and we get a better idea 
on the
variance, etc.
History
Date User Action Args
2012-04-01 11:15:40koweycreate
2012-04-01 11:47:24koweysetmessages: + msg15483