Call set-face-attribute once with correct size

set-face-attribute was being called twice, neither time with a reasonable value.