darcs

Issue 997 automated building and uploading of packages

Title automated building and uploading of packages
Priority feature Status given-up
Milestone Resolved in
Superseder Nosy List Serware, darcs-devel, dmitry.kurochkin, kowey, mornfall, thorkilnaur, zooko
Assigned To
Topics Community, Devel

Created on 2008-08-14.14:53:28 by zooko, last changed 2017-07-30.23:29:23 by gh.

Messages
msg5505 (view) Author: zooko Date: 2008-08-14.14:53:26
It is possible to use buildbot to cause the building and uploading of packages,
triggered by pushes into the central repository.  The typical practice is to
write your "build and upload" script in the scripting language of your choice,
e.g. GNU make, bash, Python, or Haskell, and then have buildbot invoke your
"build and upload" script, after a patch has been pushed to the repository, and
after all unit tests passed.  You can of course also configure it to build and
upload packages even if all the unit tests on all the builders didn't pass.

Here is an example buildbot configuration, from the allmydata.org buildbot,
which triggers the build of debian packages on various buildslaves only if the
unit tests passed on all of the debian builders:

debian_platforms = ["etch", "edgy", "feisty", "gutsy", "hardy"]
s_full_debbable = Scheduler(name="full-debbable",
                                branch=None,
                                treeStableTimer=30,
                                builderNames=debian_platforms,
                                )
c['schedulers'].append(s_full_debbable)
debian_package_builders = ["deb-"+name
                               for name in debian_platforms]
s_debs = Dependent("debs", s_full_debbable, debian_package_builders)
c['schedulers'].append(s_debs)
msg6898 (view) Author: mornfall Date: 2008-12-27.20:34:12
Hi Zooko, what's the status? I recall that you put the infrastructure in place, 
are there still reasons to keep this ticket open?
msg6936 (view) Author: zooko Date: 2008-12-29.18:03:00
The set up of the infrastructure is pretty good.  We could choose to make a goal
of having automated build and upload of binaries for all supported platforms and
then to have those binaries copied over onto the binaries page of the wiki.  If
we accomplished that goal then for those platforms there would always be an
up-to-date binary available.  Currently we have Linux, Mac, Windows, OpenBSD,
and Solaris buildbots automatically uploading binaries.
msg6940 (view) Author: kowey Date: 2008-12-30.09:16:50
The wiki currently has this text:
----------------8<-------------------------------
Several darcs builtbots are configured in a way that they upload the latest
greatest darcs binary produced by the last successful build to the publicly
available host on the Internet. Have a look here for the list of snapshots:
https://zooko.com/darcsbuildbot/uploads/

Note: since Zooko does not have CA signed certificate you will need to accept
the security exception in your browser. How to do it depends on your browser
software. 
-------------8<---------------------------

What may be nicer is to have a link to each binary separately with a description
of the corresponding build slave.  We don't necessarily have to automate it,
just find a good way to cut and paste the information from somewhere.

Another thing that would help is to find a way to deal with the problem that
anybody visiting zooko.com gets "zooko.com uses an invalid security
certificate.".  First impressions count and for most people that message just
means "run away!"

One solution I will not be able to support right now is: finding a wiki which
will allow for software uploads (no time, nor anybody to delegate to with time,
plus I don't want to launch us into a wiki bikeshed ond besides, we already want
to try gitit+darcs}).
msg8196 (view) Author: kowey Date: 2009-08-17.06:33:15
The bad news is that the integration of nightlies into buildbot is broken
(largely by our abandoning autoconf/make in favour af Cabal).

Petr has convinced me that the intersection between users who want bleeding edge
builds and users who binaries is too small for this to be a good investment of
our time.

http://irclog.perlgeek.de/darcs/2009-08-04#i_1364855

Sorry! More manpower needed!
msg8823 (view) Author: kowey Date: 2009-09-16.08:54:35
Petr had convinced me that nightly binaries was too much a fringe case to be
worth the effort.

On the other hand, Jason just brought up the suggestion of automatically
building *tagged* builds of darcs, which would be more more useful, in my opinion.
History
Date User Action Args
2008-08-14 14:53:28zookocreate
2008-08-14 15:30:46simonsetnosy: - simon
2008-08-17 20:52:42koweysettopic: + Target-2.0
nosy: + Serware, droundy
2008-08-29 21:47:54koweysettopic: + Community
nosy: + kowey
2008-12-27 20:34:21mornfallsettopic: - Target-2.0
nosy: + dmitry.kurochkin, mornfall, simon, thorkilnaur
status: unread -> unknown
messages: + msg6898
2008-12-29 18:03:04zookosetnosy: droundy, beschmi, kowey, darcs-devel, zooko, dagit, simon, thorkilnaur, dmitry.kurochkin, Serware, mornfall
messages: + msg6936
2008-12-29 18:30:43droundysetnosy: - droundy
2008-12-30 09:16:54koweysetnosy: beschmi, kowey, darcs-devel, zooko, dagit, simon, thorkilnaur, dmitry.kurochkin, Serware, mornfall
messages: + msg6940
2009-08-06 21:10:56adminsetnosy: - beschmi
2009-08-11 00:20:24adminsetnosy: - dagit
2009-08-17 06:33:17koweysetstatus: unknown -> wont-fix
nosy: kowey, darcs-devel, zooko, simon, thorkilnaur, dmitry.kurochkin, Serware, mornfall
messages: + msg8196
2009-08-25 17:37:05adminsetnosy: - simon
2009-08-27 14:25:07adminsetnosy: kowey, darcs-devel, zooko, thorkilnaur, dmitry.kurochkin, Serware, mornfall
2009-09-16 08:54:41koweysetstatus: wont-fix -> needs-implementation
nosy: + dagit
topic: + Devel
messages: + msg8823
2009-09-29 06:43:17dagitsetnosy: - dagit
2009-10-23 22:44:00adminsetnosy: + serware, - Serware
2009-10-23 23:29:50adminsetnosy: + Serware, - serware
2017-07-30 23:29:23ghsetstatus: needs-implementation -> given-up