Remove TODO.

This TODO makes no sense in terms of performance as it will need extra synchronization again so just remove it and keep it like it is.