Message: Geant4 MPI with PBS only works on one node! Not Logged In (login)
 Next-in-Thread Next-in-Thread
 Next-in-Forum Next-in-Forum

Question Geant4 MPI with PBS only works on one node! 

Forum: Multithreading
Date: 23 Jan, 2017
From: Evan Rand <Evan Rand>

Hi there, I've compiled my code with G4MPI (using MPICH 3.2) and everything works well. However, when the code is executed on our cluster it will only work on one node. When I try to use 2 or more nodes the code fails with PBS exit_status=101. Any idea what is going on? I'm at a loss here and I can't figure it out.

I see the exact same behaviour with Geant4 MPI example exMPI02. Below I've attached example PBS submission scripts. On one node everything works, on two or mode it fails.

Am I doing something dumb here?

Thanks, Evan

one node, works!

#!/bin/bash
#PBS -l nodes=1:ppn=16
#PBS -l walltime=144:00:00
#PBS -N Evan_G4
#PBS -e errorfile
#PBS -V

cd $PBS_O_WORKDIR

mpiexec -n 16 /nfs/home/geant4/builds/exMPI02/exMPI02 run.mac > out.txt

two nodes, crashes!

#!/bin/bash
#PBS -l nodes=2:ppn=16
#PBS -l walltime=144:00:00
#PBS -N Evan_G4
#PBS -e errorfile
#PBS -V

cd $PBS_O_WORKDIR

mpiexec -n 32 /nfs/home/geant4/builds/exMPI02/exMPI02 run.mac > out.txt

Inline Depth:
 1 1
 All All
Outline Depth:
 1 1
 2 2
 All All
Add message: (add)

1 Sad: Re: Geant4 MPI with PBS only works on one node!   (Andrea Dotti - 23 Jan, 2017)
 Add Message Add Message
to: "Geant4 MPI with PBS only works on one node!"

 Subscribe Subscribe

This site runs SLAC HyperNews version 1.11-slac-98, derived from the original HyperNews