Usually, my tardiness wasn't a problem.
My lateness wasn't usually a problem.