Remove the regular waffle spec and patch

Signed-off-by: Kalle Vahlman <kalle.vahlman@movial.com>