PERF: Use np.empty instead of np.ones.

No reason to use ones when we multiply everything by NaN immediately.