Interpolate YAML configs with ERB

Also, fixes tiny race condition where deleting a YAML file could raise
an Errno::ENOENT.
Merge pull request #2 from kickstarter/erb

Interpolate YAML configs with ERB