linux_drm: don't rebuild whole drm

Signed-off-by: Andreas Müller <schnitzeltony@googlemail.com>