finally I got rid of hangouts from gmail web interface
I found this information on Quora but the link was gross so I am just putting the information...
Tags: gmail, google