Bring back clause to exclude prompt setup on CI

Accidentally removed in 111d067cb99c6b6d28a3fa26c0d5aa878d829b70