note on black box test cases subdir