If an attacker can read your memory (or your swap file, etc) then you're so hosed that I'm not sure what difference this makes.