No, iMessage will not mark your message as delivered if someone's phone is off. The status will change to "delivered" once the recipient's phone is turned on.