To sign out of the Google Drive app on your phone, you must remove your account entirely from your smartphone. The aforementioned guide will help you do that very easily.