Term: downtrodden
Example: that guy doesn't seem simply out of luck, he seems downtrodden
Definition: beat down by the world and it's woes, trials, and tribulations