Wow, I only just realized that pandas 0.12.0 actually *fails* this... `loc` actually does fallback indexing!

In [13]: s.loc[4.0]
Out[13]: 4

So, uh, good fix...