Eventually, your puppy will eliminate appropriately and you can give huge praise and play. If at any time during the day you notice puppy sniffing the floor and circling or getting ready to squat, immediately interrupt him and take him outside. After each success, allow 15 minutes of freedom in the house, before placing dog back on lead or back into crate. What doesn't matter, but it needs to be loud enough to stop him in mid-flow, but not so loud that he runs to hide. This is not an angry shout.
Anger is counter-productive.
As soon as you have shouted, run to the door, calling him happily and enthusiastically and go to the designated spot. It will take him a while to relax enough to go, so be patient. Then, put him in his crate or exercise pen or safe room while you clean up the mess. Use an odor eliminator made specifically for this purpose. Ordinary household disinfectants mask the odor from us, but not from your puppy.