Only load Clippy in the backend

Signed-off-by: Gawain Lynch <gawain.lynch@gmail.com>