perf: Work around aliasing violation

Change-Id: Ib43bed1760c6f4536f770b74f0b12a7772ead8bd
Signed-off-by: Bernhard Rosenkraenzer <Bernhard.Rosenkranzer@linaro.org>
More pref fixes -Werror