I'd use six.assertRaisesRegex to check the error message as well