Finally got the alert thing to work when you're using the classify tweet feature.