XD-1791 Improving logging and handling of Spark log

- logging at error level when exit code != 0
- logging app completion message at info level
- logging Spark log at debug level
- storing Spark command in step execution context
- storing Spark log in step execution context