cut down on some specialization in inference.jl