Compile directly from git

Pretty much following #89's guide. I don't know if removing the patch rake task is okay, but it seemed better than to call the task from the builder.