It is not because of their height which is what many folks think. It actually comes from an old English cooking term, "short." Short basically referred to any baked good that was made crispier because fat was added. In this case you get short cakes.