drelu/BigJob — Issue #1: Unable to control SPMDVariation during pilot_job submission
Author: oweidner
Created: 2012-01-04 06:31:41+00:00
State: open

When I try to run BigJob via the Condor adaptor, I get the following error:

2012-01-04 01:24:49,684 - bigjob - DEBUG - Submit pilot job to: condor://localhost/
2012-01-04 01:24:49,691 - bigjob.server - ERROR - Exception: SAGA(BadParameter): condor_job: Problem launching condor job: (std::exception caught: SAGA(NotImplemented): condor_job: Condor adaptor does not support the 'SPMDVariation' attribute.

While this error comes from the condor adaptor (it doesn't support SPMDVariation), I can't find a way to unset jd.spmd_variation. It seems that it is set explicitly in bigjob/bigjob_manager.py:239.

Would it be possible to make this an option for the bigjob.start_pilot_job() method, give it a default value of "None" and don't set it at all in that case?

Is SPMDVariation variation relevant at all during pilot_job submission, or is it just set "for completeness"? In that case, we could remove it completely.