Move some RSA tests

This moves some RSA tests into a new class just to better organize them. It is prep for RSA decrypt/encrypt and #888 can be rebased after this lands.