Only add or remove class instead of overwriting all of them