Yes, and there are several ways to do it. For example, you can show a special badge on the chat bubble, a browser notification or both combined.