lattice/quda — Issue #40: MPI QUDA error: (CUDA) invalid configuration argument (node 7, blas_quda.cu:1509, hostname=curie7063
Author: kpetrov
Created: 2011-11-30 15:23:13+00:00
State: open

Salut,

I am trying to run recent QUDA on M2090 cluster and get this error: I understand it is related to shared memory overflow, but reducing local volume didn't quite help
Also, on how many GPUs do I have to run to handle 48x96 lattices?

script was:
#MSUB -r MPI_GPU_Job # Request name
#MSUB -n 16 # Total number of tasks to use
#MSUB -N 16 # Total number of nodes to use
#MSUB -T 18000 # Elapsed time limit in seconds
#MSUB -o example_%I.o # Standard output. %I is the job id
#MSUB -e example_%I.e # Error output. %I is the job id
#MSUB -q hybrid # Hybrid partition of GPU nodes
#MSUB -A gch0005 # Project ID
set -x
cd ${BRIDGE_MSUB_PWD}
module load cuda
ccc_mprun ./wilson_invert_test --xdim 32 --ydim 32 --zdim 32 --tdim 64 --xgridsize 2 --ygridsize 2 --zgridsize 2 --tgridsize 2