Caps are rewards in the game. If you complete some level the game will award you the caps. If you wish to have an unlimited supply of the bottle caps you can either get the hack or use cheats.