Question: what is it called when you can't understand someone's speech?
Answer: If you can't hear or understand something, it's unintelligible (and probably frustrating too). Definitions of unintelligible.