Split up the input handler into 2 different handlers - Key and Mouse.

game detects mouse clicks but just clicks, nothing more