Put in an ugly hack to ignore non-RSA/DSS keys.