Don't allow to build against master

We never want to do this, so if it happens, it is probably by mistake.
Update the fabric README
Cache the version

This wasn't a speed issue, just really annoying because it printed it out each
time.