To disable notifications from Messages, go to Notifications under System Settings and select Messages. From there, you can turn off message notifications on Mac