Support for regarding flaky tests failures as non-fatal

In this PR:
1) Support for flaky tests in test runner
2) Mark current v0.12 flaky tests as flaky

This is needed in preparation of some upcoming CI changes that will allow Jenkins to validate PRs more effectively.