ghost: Optimize for speed instead

Signed-off-by: Zhao Wei Liew <zhaoweiliew@gmail.com>
ghost: Disable module whitelisting

Signed-off-by: Zhao Wei Liew <zhaoweiliew@gmail.com>