ENH: Remove intermediate activate_tensors step