use better df
test fixes and doc updates