Original: The symbol for the penny was "d", from the French denier, from the Latin denarius (the solidus and denarius were Roman coins).
Simplified: The symbols for shilling and penny came from Roman coins: "s" for shilling  (from the Latin word "solidus" and "d" for penny (from the Latin "denarius").