Running cross site MPI jobs with MPIg on NGS Leeds and Manchester sites
Running cross site MPI jobs with MPIg on NGS Leeds and Manchester sites
Step 1. Create a C source file, e.g. mympitest.c in your home directory on each NGS site(ngs.leeds.ac.uk and vidar.ngs.manchester.ac.uk).
Step 2. Compile the mympitest.c on each NGS site.
On Leeds site:
/usr/local/NGS/MPIg-1.0.6-200710190227/mpicc64dbgpthr/bin/mpicc -o mympitest mympitest.c
On Manchester site:
/usr/local/NGS/MPIg-1.0.6-200710190227/gnu/mpicc64dbgpthr/bin/mpicc -o mympitest mympitest.c
Step 3. Create a mympitest.rsl in your home directory on Leeds site
mympitest.rsl:
+
( &(resourceManagerContact="ngs.leeds.ac.uk:2119/jobmanager-pbs")
(count=4)
(jobtype=mpi)
(label="subjob 0")
(environment=(GLOBUS_DUROC_SUBJOB_INDEX 0)
(LD_LIBRARY_PATH /usr/local/NGS/MPIg-1.0.6-200710190227/mpicc64dbgpthr/lib/)
(GLOBUS_ERROR_VERBOSE 1)
)
(directory=".")
(executable="mympitest")
(stdout="mympitest.out")
(stderr="mympitest.err")
)
( &(resourceManagerContact="vidar.ngs.manchester.ac.uk/jobmanager-pbs")
(count=4)
(jobtype=mpi)
(label="subjob 1")
(environment=(GLOBUS_DUROC_SUBJOB_INDEX 1)
(LD_LIBRARY_PATH /usr/local/NGS/MPIg-1.0.6-200710190227/gnu/MPIg-1.0.6-200710190227/mpicc64dbgpthr/lib/)
(GLOBUS_ERROR_VERBOSE 1)
)
(directory=".")
(executable="mympitest")
(stdout="mympitest.out")
(stderr="mympitest.err")
)
Step 4. Submit your mpi job on Leeds site:
/usr/local/NGS/MPIg-1.0.6-200710190227/mpicc64dbgpthr/bin/mpiexec --globus-rsl-file=mympitest.rsl
or globusrun -f mympitest.rsl
Step 5. Open mympitest.out or mympitest.err file for results.
Note:
The installation directory of MPIg on each NGS site may change, please use the "locate MPIg" command to locate the latest installation directory.
To see how MPIg has been used on the NGS, see the user case study on Real-time visualisation of blood flow through the brain.