Yes, you can unshare a document with a user at any time. Users may also remove themselves from a shared document using the context menu on the Documents page or through the Share dialog. Details here.