Recreate scipy fancy indexing with numpy operations