Audit Atomic usage

_Depends on #1409._

Lock less, fix bugs.