config: warn if config append is missing

Bug-Url: https://bugzilla.redhat.com/show_bug.cgi?id=1092397
Change-Id: Ic6ef2a2e349a46905bef7706c66103f6c9dc1380
Signed-off-by: Alon Bar-Lev <alonbl@redhat.com>