Removed race between test invocation and writing the yaml file

[fixes #81526514]

Signed-off-by: Nick Wade <nwade@pivotal.io>