Announcement about Workflow future plans

[Michael Wilde]

Dear André, All,

Swift (http://www.ci.uchicago.edu/swift) is a parallel scripting language for many-task applications, a computing model that encompasses most astronomy pipelines and workflows. Swift was developed at UChicago and Argonne National Laboratory by many collaborators over the last five years. It performs efficient automatic parallel execution of many-task applications on desktops, clusters, supercomputers, clouds, and grids.

Dan Katz, Jon Monette and I have developed a Swift version of Montage as a demonstration of how Swift can contribute to astronomy.  We are interested in learning how we can best contribute to the IVOA workflow effort.

Regards,

Michael Wilde and Dan Katz


----- Original Message -----
> Dear all,
> 
> As you know we will soon be facing a new generation of facilities and
> archives dealing with huge amounts of data (ALMA, LSST, panSTARRS,
> LOFAR, SKA pathfinders,..) where scientific Workflows will play an
> important role in the working methodology of astronomers. A detailed
> analysis about the state of the art of workflows in the frame of the
> VO
> involves languages, design tools, execution engines, use cases, etc. A
> major topic is also the preservation of the workflows and the
> capability
> to replay a workflow several years after its design and
> implementation.
> Several talks concerning these issues have been presented during the
> past IVOA Interop meetings (see references below).
> 
> In order to undertake this task within our community we think that as
> a
> first step a Note should be written. Participation is welcome, in
> particular, we would like to collect experiences (including use cases,
> tools, etc.), references, remarks, etc. We plan the Note to be
> published
> around September and discussed at the Pune Interop meeting. We should
> then decide on starting a working draft describing those aspects and
> possibly in a new Interest Group on Workflows.
> 
> Best regards,
> 
> 
> André Schaaff and Jose Enrique Ruiz
> 
> 
> References (not exhaustive)
> 
> Some presentations in the VO
> 
> Naples DCP session,
> http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf
> Nara DCP session,
> http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf
> Garching GWS session,
> http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf
> Baltimore Application session,
> http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf
> Trieste GWS session,
> http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf
> 
> Some projects with a link to the VO
> 
> http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow
> http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm
> http://www.wf4ever-project.org/web/guest/home
> 
> Euro-VO DCA Theory and Grid Workshops
> 
> http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf
> http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf
> http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf
> 
> ADASS
> 
> ADASS London,
> http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf
> ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J

-- 
Michael Wilde
Computation Institute, University of Chicago
Mathematics and Computer Science Division
Argonne National Laboratory