Reduce test matrix to main versions of Python

Signed-off-by: Stefan Marr <git@stefan-marr.de>