spec: Remove igor stuff if not needed

Change-Id: Ib94e1b35f1e0ba4b413a472e41508501d0e9a655
Signed-off-by: Fabian Deutsch <fabiand@fedoraproject.org>