How did I forget to do this? I forgot to remove the old binary config and put in my custom one. Lets hope this works...
Did some testing, added files from lb build to .gitignore.