HPCC-11302 - Fix implicit super file creation transaction retry

Hitting a timeout and retrying caused the automatically creted
superfile to be missing to any transaction steps that relied on
it.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11308 - ensure transaction object files are released on retry

Files transaction looked up in prepartion for manipulation inside
transaction steps were held (linked) and therefore retained a
read lock on those files. If the preparation failed to lock the
files they were release, however if they succeeded, but
subsequent steps failed they were retained whilst the transaction
mechanism sat in it's retry sleep phase.
The net effect would be that other jobs/users might be blocked
from gaining exclusive access to files that had been referenced
inside a transaction.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11324 - Allow DFS to delete external file via logical ref.

Permit a couple of couple of places to delete external files

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
HPCC-11309 - Ensure IDFUHelper cooperate with transactions

Ensure they release their locks before committing transaction.
Also move remove super file operation into transaction.

Signed-off-by: Jake Smith <jake.smith@lexisnexis.com>
Merge pull request #5768 from jakesmith/hpcc-11302

HPCC-11302 - Fix implicit super file creation transaction retry

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #5771 from jakesmith/hpcc-11309

HPCC-11309 - Ensure IDFUHelper cooperate with transactions

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #5769 from jakesmith/hpcc-11308

HPCC-11308 - ensure transaction object files are released on retry

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge pull request #5786 from jakesmith/hpcc-11324

HPCC-11324 - Allow DFS to delete external file via logical ref.

Reviewed-By: Gavin Halliday <gavin.halliday@lexisnexis.com>
Reviewed-By: Richard Chapman <rchapman@hpccsystems.com>
Merge branch 'master' into candidate-5.0.0

Signed-off-by: Richard Chapman <rchapman@hpccsystems.com>