Java CoG Kit GridFTP monitor
From Java CoG Kit
Contents |
Goals
identify a more precise short term goal as to minimize the time Mike spends on the project
showning we can do gridftp between sites
have a cron job through an automatic test running
have the result be available on a web page
documentation on the wiki on how to set this up and how to add new resoources
documentation on how to set up a cron script publishing the information
document the different versions of the gridftp
have a table that documents the different gridftp versions
derive the versions of gridftp automatically
display the information in a variety of views
one of the views is simply a matrix with blobs like red green yellow that show if things work or not.
other charts are based on Mikes already in place solution.
e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program.
How we get there?
identify a more precise short term goal as to minimize the time Mike spends on the project
showning we can do gridftp between sites
have a cron job through an automatic test running
have the result be available on a web page
documentation on the wiki on how to set this up and how to add new resoources
documentation on how to set up a cron script publishing the information
document the different versions of the gridftp
have a table that documents the different gridftp versions
derive the versions of gridftp automatically
display the information in a variety of views
one of the views is simply a matrix with blobs like red green yellow that show if things work or not.
other charts are based on Mikes already in place solution.
e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program.
everyone getting account everywhere
update mikes program with hostnames
update the documentation so somone could download the program and can run it themselfs
develop a new google like mechanism that fetches standard output format and can combine it.
Gregors personal goals
identify a more precise short term goal as to minimize the time Mike spends on the project
showning we can do gridftp between sites
have a cron job through an automatic test running
have the result be available on a web page
documentation on the wiki on how to set this up and how to add new resoources
documentation on how to set up a cron script publishing the information
document the different versions of the gridftp
have a table that documents the different gridftp versions
derive the versions of gridftp automatically
display the information in a variety of views
one of the views is simply a matrix with blobs like red green yellow that show if things work or not.
other charts are based on Mikes already in place solution.
e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program.
everyone getting account everywhere
update mikes program with hostnames
update the documentation so somone could download the program and can run it themselfs
develop a new google like mechanism that fetches standard output format and can combine it.
getting account everywhere
being able to test jobsubmisison
being able to test gridftp
being able to test gridftp on backend nodes if they have gridftp
having a diagram with a graph and different thickness of speeds/bandwidth ...
make karajan real good looking (e.g. present a nice and working solution)
Roadmap
identify a more precise short term goal as to minimize the time Mike spends on the project
showning we can do gridftp between sites
have a cron job through an automatic test running
have the result be available on a web page
documentation on the wiki on how to set this up and how to add new resoources
documentation on how to set up a cron script publishing the information
document the different versions of the gridftp
have a table that documents the different gridftp versions
derive the versions of gridftp automatically
display the information in a variety of views
one of the views is simply a matrix with blobs like red green yellow that show if things work or not.
other charts are based on Mikes already in place solution.
e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program.
everyone getting account everywhere
update mikes program with hostnames
update the documentation so somone could download the program and can run it themselfs
develop a new google like mechanism that fetches standard output format and can combine it.
getting account everywhere
being able to test jobsubmisison
being able to test gridftp
being able to test gridftp on backend nodes if they have gridftp
having a diagram with a graph and different thickness of speeds/bandwidth ...
make karajan real good looking (e.g. present a nice and working solution)
get feedback from GIN on which grids they like to see
identify other Grids
apply for accounts there
Useful Links
Testbed
TeraGrid
identify a more precise short term goal as to minimize the time Mike spends on the project
showning we can do gridftp between sites
have a cron job through an automatic test running
have the result be available on a web page
documentation on the wiki on how to set this up and how to add new resoources
documentation on how to set up a cron script publishing the information
document the different versions of the gridftp
have a table that documents the different gridftp versions
derive the versions of gridftp automatically
display the information in a variety of views
one of the views is simply a matrix with blobs like red green yellow that show if things work or not.
other charts are based on Mikes already in place solution.
e-mail msg to GIN working group. contains a link to the cogkit web page that shows the published results from mikes program.
everyone getting account everywhere
update mikes program with hostnames
update the documentation so somone could download the program and can run it themselfs
develop a new google like mechanism that fetches standard output format and can combine it.
getting account everywhere
being able to test jobsubmisison
being able to test gridftp
being able to test gridftp on backend nodes if they have gridftp
having a diagram with a graph and different thickness of speeds/bandwidth ...
make karajan real good looking (e.g. present a nice and working solution)
get feedback from GIN on which grids they like to see
identify other Grids
apply for accounts there
tg-gridftp.iu.teragrid.org
gridftp-hg.ncsa.teragrid.org
gridftp-co.ncsa.teragrid.org
gridftp-cu.ncsa.teragrid.org
gridftp-w.ncsa.teragrid.org
tg-gridftp.ornl.teragrid.org
tg-gridftp.psc.teragrid.org
tg-gridftp.bigben.psc.teragrid.org
tg-gridftp.purdue.teragrid.org
tg-gridftp.sdsc.teragrid.org
ds-gridftp.sdsc.edu
tg-gridftp.lonestar.tacc.teragrid.org
tg-viz-gridftp.tacc.teragrid.org
tg-gridftp.uc.teragrid.org
gridftp-hg.ncsa.teragrid.org
tg-gridftp.psc.teragrid.org
tg-gridftp.bigben.psc.teragrid.org
tg-gridftp.purdue.teragrid.org
tg-gridftp.sdsc.teragrid.org
tg-gridftp.uc.teragrid.org
Other Grids
Target:
d-Grid skynet jazz barcelona reading? japan grid australia
we need contacts from them and we will only test gridftp
Installing and Running
- Make sure you have both Apache Ant and a Java SDK installed, and their executables in the executable path.
- Download and install the CoG Kit and tests. To do so simply
- download the gftpt-install.sh script. The contents of the script can be viewed in our SVN repository
- create a directory called "gin"
- place the script into this directory
- execute the script which automatically installs and compile the test program:
- Edit the hosts file and customize the set of sites.
COMMENT: THIS IS TOO MUCH VARIATION, JUST ONE SOLUTION
A site looks like this:host("<name>"service(provider="gsiftp", type="file", url="gsiftp://<host>[:<port>]") )
Or, you could use the iterated approach:
for(name, ["<name1>", "<name2>", ...]host(nameservice(provider="gsiftp", type="file", url="gsiftp://{name}") ) )
- Edit the settings file (settings.k) and customize the values (WHY?)
- Run the tests: cog-workflow runtests.k or
- The output files should appear in the "output" directory
what this, this should be in one script: gftpt-run.sh
