I have no experience with either but at least in theory RTX can achieve much greater performance due to the fact the hardware has dedicated processing units, while traditional shaders will have to emulate it; a look at Wikipedia shows that the ray-tracing units have 5-10x the performance of the traditional processing