Revert to naive advanced indexing by densfying cloumn first