Java CoG Kit GridFTP monitor

Goals

<tasks> [1] identify a more precise short term goal as to minimize the time Mike spends on the project [1] showning we can do gridftp between sites [1] have a cron job through an automatic test running [1] have the result be available on a web page [1] documentation on the wiki on how to set this up and how to add new resoources [1] documentation on how to set up a cron script publishing the information [2] document the different versions of the gridftp [2] have a table that documents the different gridftp versions [2] derive the versions of gridftp automatically [2] display the information in a variety of views [2] one of the views is simply a matrix with blobs like red green yellow that show if things work or not. [1] other charts are based on Mikes already in place solution. [1] e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program. </tasks>

How we get there?

<tasks> [ ] everyone getting account everywhere [ ] update mikes program with hostnames [ ] update the documentation so somone could download the program and can run it themselfs [ ] develop a new google like mechanism that fetches standard output format and can combine it. </tasks>

Gregors personal goals

<tasks> [ ] getting account everywhere [ ] being able to test jobsubmisison [ ] being able to test gridftp [ ] being able to test gridftp on backend nodes if they have gridftp [ ] having a diagram with a graph and different thickness of speeds/bandwidth ... [ ] make karajan real good looking (e.g. present a nice and working solution) </tasks>

Roadmap

<tasks> [ ] get feedback from GIN on which grids they like to see [ ] identify other Grids [ ] apply for accounts there </tasks>

Testbed

TeraGrid

<tasks> [ ] tg-gridftp.iu.teragrid.org [x] gridftp-hg.ncsa.teragrid.org [ ] gridftp-co.ncsa.teragrid.org [ ] gridftp-cu.ncsa.teragrid.org [ ] gridftp-w.ncsa.teragrid.org [ ] tg-gridftp.ornl.teragrid.org [ ] tg-gridftp.psc.teragrid.org [ ] tg-gridftp.bigben.psc.teragrid.org [ ] tg-gridftp.purdue.teragrid.org [ ] tg-gridftp.sdsc.teragrid.org [ ] ds-gridftp.sdsc.edu [ ] tg-gridftp.lonestar.tacc.teragrid.org [ ] tg-viz-gridftp.tacc.teragrid.org [x] tg-gridftp.uc.teragrid.org [ ] gridftp-hg.ncsa.teragrid.org [ ] tg-gridftp.psc.teragrid.org [ ] tg-gridftp.bigben.psc.teragrid.org [ ] tg-gridftp.purdue.teragrid.org [ ] tg-gridftp.sdsc.teragrid.org [ ] tg-gridftp.uc.teragrid.org </tasks>

Other Grids

Target:

d-Grid
skynet
jazz
barcelona
reading?
japan grid
australia

we need contacts from them and we will only test gridftp

Installing and Running

1. Make sure you have both Apache Ant and a Java SDK installed, and their executables in the executable path.
2. Download and install the CoG Kit and tests. To do so simply
   1. download the gftpt-install.sh script. The contents of the script can be viewed in our SVN repository
   2. create a directory called "gin"
   3. place the script into this directory
   4. execute the script which automatically installs and compile the test program:
3. Edit the hosts file and customize the set of sites.

COMMENT: THIS IS TOO MUCH VARIATION, JUST ONE SOLUTION

A site looks like this:
host("<name>"
  service(provider="gsiftp", type="file", url="gsiftp://<host>[:<port>]")
)

Or, you could use the iterated approach:

for(name, ["<name1>", "<name2>", ...]
  host(name
    service(provider="gsiftp", type="file", url="gsiftp://{name}")
  )
)

1. Edit the settings file (settings.k) and customize the values (WHY?)
2. Run the tests: cog-workflow runtests.k or

• The output files should appear in the "output" directory

what this, this should be in one script: gftpt-run.sh