Ideally we'd do this by operating on the data in whatever axes format it comes in.

You could do this by constructing a tuple with `slice(None)` in all the places you mean to have a ":", and using that as an index.