added logging and rapaired test data processing