It might arouse suspicion if you did not stay out till the usual time.
People might get suspicious if you came home early.