Turns out there were two rsyslog.conf files and only one actually does stuff