Add 'skip' configuration option.

Includes integration tests