Use proper mutex copying, aka don't copy them and instead use a shared_ptr