darcs

Issue 1464 Adopt TAP format for functional test output.

Title Adopt TAP format for functional test output.
Priority wishlist Status wont-fix
Milestone Resolved in
Superseder Nosy List darcs-devel, dmitry.kurochkin, jaredj, kowey, markstos, thorkilnaur, twb
Assigned To
Topics ProbablyEasy

Created on 2009-05-17.06:25:35 by twb, last changed 2009-08-27.14:21:48 by admin.

Messages
msg7828 (view) Author: twb Date: 2009-05-17.06:25:32
Mark Stosberg <mark@summersault.com> writes:

> My suggestion for improving the tests is to use the standard TAP
> output format. The Perl tests used to do this. There are a number of
> tools and additional automations that become possible or easy when
> this is done.
>
> There is a library to help easily do this with shell scripts:
> http://testanything.org/wiki/index.php/Tap-functions
>
> TAP has also been ported to Haskell, so it could be used for the unit
> tests as well:
>
> http://testanything.org/wiki/index.php/HaskellTapModule
msg8029 (view) Author: kowey Date: 2009-08-06.14:22:14
I'm not entirely clear what this buys us and if there is any cost, but I'll
leave this open in case anybody wants to work on it
msg8044 (view) Author: twb Date: 2009-08-07.02:21:53
On Thu, Aug 06, 2009 at 02:22:17PM +0000, Eric Kow wrote:
> I'm not entirely clear what this buys us and if there is any cost,
> but I'll leave this open in case anybody wants to work on it

This ticket should probably be retitled.  The idea is to adopt *A*
standard functional test framework (replacing our NIH version),
because it ought to reduce our maintenance burden.

TAP is simply an example that was mentioned on the mailing list.
msg8067 (view) Author: markstos Date: 2009-08-10.15:06:41
On Thu, 06 Aug 2009 14:22:17 +0000
Eric Kow <bugs@darcs.net> wrote:

> 
> Eric Kow <kowey@darcs.net> added the comment:
> 
> I'm not entirely clear what this buys us and if there is any cost, but I'll
> leave this open in case anybody wants to work on it

TAP, and perhaps other standard test outputs, have a whole range of tools 
that you can use to manipulate them.

For example, 'prove' is an excellent, versatile tool for running test suites
different ways. It allows you to express things like: "please re-run the test
suite, but this time only run the tests that failed time".

However, if there are no specific complaints about managing the test suite,
then this ticket can be closed, as it as means-to-an-end, not a goal in itself.

    Mark
msg8068 (view) Author: kowey Date: 2009-08-10.15:27:39
Alright I'm going to wont-fix this and note that we aren't opposed if anybody
does work on it, we just aren't experiencing sufficient pain with our test suite
to justify doing anything about this.  Patches welcome, but *shrug* otherwise :-)
History
Date User Action Args
2009-05-17 06:25:35twbcreate
2009-08-06 14:22:17koweysetpriority: wishlist
nosy: + markstos, jaredj
topic: + ProbablyEasy
status: unread -> unknown
messages: + msg8029
2009-08-07 02:21:55twbsetnosy: kowey, markstos, simon, twb, thorkilnaur, jaredj, dmitry.kurochkin
messages: + msg8044
2009-08-10 15:06:45markstossetnosy: kowey, markstos, simon, twb, thorkilnaur, jaredj, dmitry.kurochkin
messages: + msg8067
2009-08-10 15:27:42koweysetstatus: unknown -> wont-fix
nosy: kowey, markstos, simon, twb, thorkilnaur, jaredj, dmitry.kurochkin
messages: + msg8068
2009-08-25 17:45:08adminsetnosy: + darcs-devel, - simon
2009-08-27 14:21:48adminsetnosy: kowey, markstos, darcs-devel, twb, thorkilnaur, jaredj, dmitry.kurochkin