I have a SGE cluster with a qmaster node and 6 exec hosts. MPI version is Intel(R) MPI Library for Linux. I added 3 nodes to the cluster and since then MPI stopped working. I get the following error when I run a sample script:
$ cat script.sh
#!/bin/sh
# Export all environment variables
#$ -V
# Your job name
#$ -N mpi_hello
# Use current working directory
#$ -cwd
# Join stdout and stderr
#$ -j y echo "Got $NSLOTS processors." mpirun -np $NSLOTS /home/sge_users/s/mpi_sample_test/mpitest
$ qsub -pe mpi 4 script.sh
$ cat mpi_hello.o657
Got 6 processors.
==================================================================================
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= PID 27863 RUNNING AT marcher7
= EXIT CODE: 153
= CLEANING UP REMAINING PROCESSES
= YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
= BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
= PID 27863 RUNNING AT marcher7
= EXIT CODE: 25
= CLEANING UP REMAINING PROCESSES
= YOU CAN IGNORE THE BELOW CLEANUP MESSAGES
==================================================================================
Although when I run the mpirun command without SGE it works just fine. I've restarted the SGE, checked SGE logs and /var/log/messages, and googled the error but didn't find the problem. Is there a way to interpret those exit codes? Thanks
برچسب:
نویسنده: استخدام کار