Add Jenkins customizations at runtime to avoid increasing the image size