layers: add minnow and rpi, drop aarch64 since it breaks gcc builds

Signed-off-by: Koen Kooi <koen@dominion.thruhere.net>