It takes just a few clicks, go to the account you want to stop following and click on a button "unfollow".