Fix latency logic in libfswatch

This fixes #67, by first reverting unnecessary commit and then fixing it properly (I hope).