Installing a Grid

From Java CoG Kit

Jump to: navigation, search

Gregor von Laszewski

Contents

About this Document

This document presents some helpful links to set up a Grid with the Globus Toolkit. It also introduces possibilities to use SSH services and a single computer with the Karajan workflow engine.

Format

We have augmented the document with comments/tasks at places where we found issues. Our intend is to address these issues in a future release. A task will appear as follows

Image:task.png Text describing the task (wiki account name the task is assigned to)

In case you have a wiki account, you can add new tasks to the Documentation as documented in our Wiki Help.

Setting up a Workstation Grid with Globus

This installation is based on GT 4.0.2 WS.

The installation of a Globus environment is not as trivial as downloading a binary, unpacking it and running a program. A Grid is based on a security concept that requires the setup, maintenance, and deployment of a virtual organisation based on trust management. To do so you need to carefully read the documentation provided at the Globus toolkit Web pages. Please follow this link to the binary distributions of the toolkit:

However, before you install any of them it is important that you read and understand the restrictions for each bundle based on the type you like to install. AN extensive set of documentation is available from

Next we describe how to set up a Grid with three workstations. Two of the workstations have Grid services installed, while the third machine has not. We show how we can through the CoG Kit easily execute tasks such as executing a program or transferring files to the machines.

We proceed with the following steps:

  1. download a binary installation
  2. install a binary installation
  3. set up a simple ca
  4. create host certificates for the two servers
  5. create user certificates for a number of users
  6. set up use privileges for the services
  7. install the Java CoG Kit on the client machine
  8. execute a simple job submission with the CoG Kit to both servers
  9. execute a simple file transfer with the CoG Kit to both servers

[ ] Please create for each item above a subsection and fill it out with sufficient detail so others can replicate it. If additional steps need to be done, please include them. You can refer to existing documentation, but must be somewhat specific with links to the appropriate subsection of the GT documentation. Assigned to (Guru)

Proxy Certificate Generation

The Globus Toolkit contains three different formats of the proxy certificate

  • 1. Globus "legacy" proxy available prior to GT v2.*
  • 2. Globus proxy (non rfc-compliant) available in GT v2.* and later releases
  • 3. RFC-compliant proxy available in GT v4.* http://www.faqs.org/rfcs/rfc3820.html

Pre-GT2.* servers require the Globus legact proxy. Servers in GT2.* and beyond work only with the non-rfc-compliant proxy. Servers in GTv4 work with both, rfc-compliant and non-compliant proxies.

The Different types of proxy certificates can be generated as follows:

$> grid-proxy-init
 1) with -old - generates 'globus legacy proxy' (since gt2)
 2) with -rfc - generates 'rfc complaint proxy' (since gt4)
 3) without any switch - generates 'pre-rfc proxy' (since gt3)

Grid-Proxy-Init Command Line

Invoke grid-proxy-init from the cog/dist/<cog_version>/bin directory after compiling cog by running ant dist. This prompts you for your grid passphrase which you had used to create your certificate. There are other params that can be used to increase the lifetime of your proxy. Please use the -help option to find out what options are available.

$ ./grid-proxy-init
CYGWIN_NT-5.1
Your identity: DC=org,DC=doegrids,OU=People,CN=Albert 897935
Enter GRID pass phrase for this identity:
Creating proxy, please wait...
 Proxy verify OK
Your proxy is valid until Sat Apr 29 02:22:18 CDT 2006

Grid-Proxy-Init GUI based

Invoking cog-proxy-init would startup the gui based proxy init in cog/dist/<cog_version>/bin directory. Enter the password here and choose the appropriate options.

Image:grid-proxy-init.jpg

The options button shows the option panel as below

Image:grid-proxy-init-options.jpg

Setting up a Distributed Environment with SSH Services

This document will explain how to use three machines to which you can connect via ssh. We demonstrate how two of the machines can be used as servers and the third as a client.

[ ] Please create for each item above a subsection and fill it out with sufficient detail so others can replicate it. If additional steps need to be done, please include them. You can refer to existing documentation, but must be somewhat specific with links to the appropriate subsection of the GT documentation. Assigned to (Guru)
[ ] assigned to (TBD)

Using a Single Computer without a Grid

This example demonstrates what you can do to use the Java CoG Kit workflow system without installing a Grid.

[ ] Please create for each item above a subsection and fill it out with sufficient detail so others can replicate it. If additional steps need to be done, please include them. You can refer to existing documentation, but must be somewhat specific with links to the appropriate subsection of the GT documentation. Assigned to (Guru)
[ ] assigned to (TBD)
[ ] assigned to (TBD)

Personal tools
Collaboration and Jobs