Original: The symbol for the shilling was "s" — not from the first letter of the word, but from the Latin solidus.
Simplified: The symbols for shilling and penny came from Roman coins: "s" for shilling  (from the Latin word "solidus" and "d" for penny (from the Latin "denarius").