Survey on Grid Workflows
From Java CoG Kit
Gregor von Laszewski, Argonne National Laboratory, Argonne, IL 60440
Contents |
Overview Table
| Name | Interface | Language | Tools | Comments | Description |
|---|---|---|---|---|---|
| Askalon | GUI | AGWL CGWL | Globus Tookit | Abstract workflow described by AWFL to concrete workflow described by CWFL | |
| Dagman | command line | Direct Acyclic Graph | GT2 (Condor-G) | Direct Acyclic Graph, Does not deal with either Web or Grid based services | |
| Fiswidget | GUI | custom XML | NA | neuroimaging analysis | |
| Gridant | Graphical workflow visualizer (ANL) | NA | CoG | Superseeded by CoG Karajan | |
| GridNexus | PtolemyII Java GUI | JXPL | GT3 | Graphic interface for complex data analysis | |
| Grid Service Broker | Command line, Java based Grid API | NA | GT2, Alchemi | Aims to parametric computing | |
| GRMS | command line and GridSphere Web portlet | DAG/ PetriNet | Pre-WS GT | meta-scheduling system, remote job control | |
| JOpera | Eclipse 3.1 | Directed Cyclic Labeled Graphs | WSDL, WSRF, GT4, SSH, Condor | extensible services | |
| CoG Kit (Karajan) | command line, GUI | XML based | GT2.4, GT3.02, SSH | Aims to suit workflow | |
| Kepler | GUI | NA | NA | actor oriented modeling | |
| Matrix | NA | DGL | CoG | data grid workflow, peer to peer infrastructure | |
| Nimrod | GUI | NA | Globus Tookit | Distributed parametric modeling, combines DCE and remote queuing system | |
| Pegasus | NA | NA | Globus Tookit | Mapping abstract workflow to executable workflow with some optimization methods | |
| Taverna | Freefluo-workflow enactment engine, Taverna Workbench-GUI | Scufl XScufl | NA | can be extensible by plug in processors | |
| Triana | Command line, GUI | WSFL | NA | peer to peer mechanism |
Incomplete list of Workflows reported to us
Java CoG Kit Workflow (Karajan)
- Link: http://www.cogkit.org
- Description: Karajan is a workflow specification language and execution engine, being developed within the Java CoG Kit. Execution engine is based on the Globus Toolkit, while the language is a common purpose XML-based language which can express complicated workflows including conditional control flows and loops.
ASKALON
- Link: http://dps.uibk.ac.at/projects/askalon/parallel/
- Purpose: A programming environment and tool set for cluster and grid computing
- Comment: tools to support automated parallelization and optimization of programs
Matrix
- Link: http://www.npaci.edu/DICE/SRB/matrix/
- Purpose: Data grid workflows and data grid administration
- Description: The SDSC Matrix Project builds a peer-to- peer infrastructure for Grid Workflow Management Systems (GfMS) and uses the Data Grid Language, which can be used to describe, query and control the execution of gridflow pipelines
Nimrod
- Link: http://www.csse.monash.edu.au/~davida/nimrod/
- Purpose: Distributed parametric modelling
- Description: Nimrod uses a declarative parametric modeling language to express a parametric experiment and provides machinery that automates the task of formulating, running, monitoring, and collating the results from the multiple individual experiments.
GSFL
Description: Based on the Web Services Flow Language (WSFL), provides some specific enhancements for grid applications:peer-to-peer service interaction and complicated lifecycle management, is no longer maintained.
GridNexus and JXPL
- Link: http://gridnexus.org/
- References: http://www.globusworld.org/program/abstract.php?id=34
- Description: JXPL is LISP with XML syntax, implemented in Java. GridNexus is a data-flow oriented visual editor for JXPL. Uses a GUI to write a script in a new XML based language called JXPL, separates the graphical, interactive construction of the model from its execution
Taverna
- Link: http://www.mygrid.org.uk/
- References: http://www.gridlab.org/WorkPackages/wp-3/
- Purpose: Supporting workflows in bioinformatics
- Description: provides a language and software tools to facilitate easy use of workflow and distributed compute technology within the eScience community
GSiB
- Link: http://users.cs.cf.ac.uk/Yan.Huang/GridWF/GSiB.htm
- Description: intended to be an environment providing visual interfaces to a suite of tools for creating, deploying, managing, using, and querying Grid services, and serves as the intermediary between general users and the underlying OGSA-compliant Grid system
Triana
- http://www.trianacode.org/
- Application: Gravitational wave (GW) data analysis
- Description: Combines an intuitive visual interface with powerful data analysis tools,
includes a large library of pre-written analysis tools, easily integrate users’ own tools
JISGA
- Link: http://www.wesc.ac.uk/projects/jisga/ HTML]
GSiB
Link: http://users.cs.cf.ac.uk/Yan.Huang/GridWF/GSiB.htm
GRMS
- Link: http://www.man.poznan.pl/pcss/public/main/index.html
- Refernces: PDF
S-WFMS
- Link: HTML
Triana
Virtual Data System
- http://vds.uchicago.edu/twiki/bin/view/VDSWeb/WebMain
- Description: Uses Chimera and Pegasus, check also Grid3. A neat concept of applying function-like transformations to data. Basic trasformations (jobs) can be composed in order to create more complex transformations (workflows). The resulting abstract composition is then supplied input data, concretized (bound to specific computational resources) by a workflow planner (Pegasus), and then submitted for execution using Condor DAGMan.
Not yet reviewed
Action
Visual Workflo(FileNet)
OpenPM
- References: PDF
Flowmark
Ultimus
Inconcert
- References: HTML
Refernces
- http://www.extreme.indiana.edu/swf-survey/
- Converted page from Alek Scientific Workflow Survey
- http://arxiv.org/abs/cs.DC/0503025
- http://www.gridworkflow.org/snips/gridworkflow/space/start
- http://is.tm.tue.nl/research/patterns/
- http://www.activebpel.org/index.html
- [1] Sriram Krishnan, Patrick Wagstrom, Gregor von Laszewski, “GSFL: A Workflow Framework for Grid Services”, http://www.caip.rutgers.edu/~zhljenny/PDF/gsflAFrameworkforGridServices.pdf
- [2] I. Foster, C. Kesselman, and S. Tuecke, “The anatomy of the grid: enabling scalable virtual organization,” Int. J. Supercomputer Application, vol.15, no.3, 2001
- [3] Francesco Nerieri, Radu Prodan, Hong-Linh Truong, Thomas Fahringer, “Performance Analysis of Grid Workflow Application”
- [4] Lee-Sub LEE, Soo-Hyun PARK, and Doo-Kwon BAIK, “A Workflow Enactment Model for Next Generation Internet services”, IEICE TRANS.FUNDAMENTALS, vol.E87-A, no.6 June * 2004
- [5] Jiang Zhu, “Research on WebService Based Grid and An Improved Policy of Resource State Update”, Tianjin University Thesis
- [6] http://www.chinagrid.com/data/grid-20.htm
Acknowledgments
- Alexander Slominski (IU)
- Gregor von Laszewski (ANL)
- Mike Hategan (UC)
- Yanwei Wu (IIT)
