ssa.c: Push a access task to thread pool only if number of workers > 1

Otherwise, use the access thread for the computation.

Signed-off-by: Sasha Kotchubievsky <sashakot@mellanox.com>
Signed-off-by: Hal Rosenstock <hal@mellanox.com>