The rudiment is virtually the same either way you begin. When practicing Single Paradiddles, it's always a good idea to follow a set of rules or guidelines that will help you in becoming better at performing them. Starting at a very slow tempo will actually help you play faster later on down the line. Don't try to play any rudiment fast right away. Get used to the mechanics of the rudiment first before moving on to a faster tempo.
Patience is definitely a virtue here.
It will help you play them better especially at the faster tempos if you play the accents. From slow to very fast and back to slow. B. From very soft to very loud and back to very soft. At one tempo setting for several minutes. That's pretty much the Single Paradiddle in a nutshell.