We would have to create a separate plugin (not only plugin.xml) that would also have to be excluded from PDE. It would have to be added as a dependency to the test plugin. Otherwise, tests will fail.
I don't see any difference whether they are in a separate or in the test plugin, but will do it if you insist. There is no reason to include a test plugin in the PDE unless you execute tests.