pydata/pandas — Issue #876: add an input data sanity-checker 
Author: timmie
Created: 2012-03-07 15:52:40+00:00
State: open

Sometimes, ASCII data can contain strange fragments such as "/", "-", "%", "`", "#", "~" in the numerical data columns.
These charaters could either be inserted by a mal-functioning data logger (obeservation data), differencing conventions on NoData or wrong exports from other programs.

Before processing such data into a array/dataframe, there need to be sanity checks of the data.

Such a checker would go through the data if ascii read-in fails and show on which line such a read error occurs.
Optionally, such das checker tools would offer the to replace data by a NaN or a defined value just like "fill_value".