Add timing channel protection for fixed address mapping