Remove superfluous locks

@ch3cooli Based on your comments I created this PR.

Does it fix your crashes? - I wasn't able to reproduce them.