Fix leaking empty concurrent hashmaps

In the side note. This javadoc accounts for 36% of entire javadoc for this class.

Also I think root cause of this bug is non-optimal abstraction where two maps are maintained where key is a second. Ideally entries/scheduler should be abstracted and only one map should be maintained.