Survey on Grid Workflows

From Java CoG Kit

Jump to: navigation, search

Gregor von Laszewski, Argonne National Laboratory, Argonne, IL 60440

Contents

Overview Table

Name Interface Language Tools Comments Description
Askalon GUI AGWL CGWL Globus Tookit Abstract workflow described by AWFL to concrete workflow described by CWFL
Dagman command line Direct Acyclic Graph GT2 (Condor-G) Direct Acyclic Graph, Does not deal with either Web or Grid based services
Fiswidget GUI custom XML NA neuroimaging analysis
Gridant Graphical workflow visualizer (ANL) NA CoG Superseeded by CoG Karajan
GridNexus PtolemyII Java GUI JXPL GT3 Graphic interface for complex data analysis
Grid Service Broker Command line, Java based Grid API NA GT2, Alchemi Aims to parametric computing
GRMS command line and GridSphere Web portlet DAG/ PetriNet Pre-WS GT meta-scheduling system, remote job control
JOpera Eclipse 3.1 Directed Cyclic Labeled Graphs WSDL, WSRF, GT4, SSH, Condor extensible services
CoG Kit (Karajan) command line, GUI XML based GT2.4, GT3.02, SSH Aims to suit workflow
Kepler GUI NA NA actor oriented modeling
Matrix NA DGL CoG data grid workflow, peer to peer infrastructure
Nimrod GUI NA Globus Tookit Distributed parametric modeling, combines DCE and remote queuing system
Pegasus NA NA Globus Tookit Mapping abstract workflow to executable workflow with some optimization methods
Taverna Freefluo-workflow enactment engine, Taverna Workbench-GUI Scufl XScufl NA can be extensible by plug in processors
Triana Command line, GUI WSFL NA peer to peer mechanism


Incomplete list of Workflows reported to us

Java CoG Kit Workflow (Karajan)

  • Link: http://www.cogkit.org
  • Description: Karajan is a workflow specification language and execution engine, being developed within the Java CoG Kit. Execution engine is based on the Globus Toolkit, while the language is a common purpose XML-based language which can express complicated workflows including conditional control flows and loops.

ASKALON

Matrix

  • Link: http://www.npaci.edu/DICE/SRB/matrix/
  • Purpose: Data grid workflows and data grid administration
  • Description: The SDSC Matrix Project builds a peer-to- peer infrastructure for Grid Workflow Management Systems (GfMS) and uses the Data Grid Language, which can be used to describe, query and control the execution of gridflow pipelines

Nimrod

  • Link: http://www.csse.monash.edu.au/~davida/nimrod/
  • Purpose: Distributed parametric modelling
  • Description: Nimrod uses a declarative parametric modeling language to express a parametric experiment and provides machinery that automates the task of formulating, running, monitoring, and collating the results from the multiple individual experiments.

GSFL

Description: Based on the Web Services Flow Language (WSFL), provides some specific enhancements for grid applications:peer-to-peer service interaction and complicated lifecycle management, is no longer maintained.

GridNexus and JXPL

Taverna

GSiB

  • Link: http://users.cs.cf.ac.uk/Yan.Huang/GridWF/GSiB.htm
  • Description: intended to be an environment providing visual interfaces to a suite of tools for creating, deploying, managing, using, and querying Grid services, and serves as the intermediary between general users and the underlying OGSA-compliant Grid system

Triana

  • http://www.trianacode.org/
  • Application: Gravitational wave (GW) data analysis
  • Description: Combines an intuitive visual interface with powerful data analysis tools,

includes a large library of pre-written analysis tools, easily integrate users’ own tools

JISGA

GSiB

Link: http://users.cs.cf.ac.uk/Yan.Huang/GridWF/GSiB.htm

GRMS

S-WFMS

Triana

Virtual Data System

  • http://vds.uchicago.edu/twiki/bin/view/VDSWeb/WebMain
  • Description: Uses Chimera and Pegasus, check also Grid3. A neat concept of applying function-like transformations to data. Basic trasformations (jobs) can be composed in order to create more complex transformations (workflows). The resulting abstract composition is then supplied input data, concretized (bound to specific computational resources) by a workflow planner (Pegasus), and then submitted for execution using Condor DAGMan.

Not yet reviewed

Action

Visual Workflo(FileNet)

OpenPM

  • References: PDF

Flowmark

Ultimus

Inconcert

Refernces

Acknowledgments

  • Alexander Slominski (IU)
  • Gregor von Laszewski (ANL)
  • Mike Hategan (UC)
  • Yanwei Wu (IIT)
Personal tools
Collaboration and Jobs