adding debugging and some auditing trails for verifying quality of datasets