Seems like particles were being stomped, so I tried swapping dead particles instead of just replacing them. Seems to work a bit better, but I'm not convinced there isn't still some stomping going on.