Fixes suboptimal and buggy lastN/pinned endpoint calculation.
Removes superfluous synchronization in the simulcast manager.