Might have changed now, but previously, TestNG would wrongly run this method unless the annotation to disable it explicitly was there. IOW, TestNG reacts (or at least, used to) differently to Scala test classes in some occasions.