Make packet use message's buffer if it exists