The first step is to potty train your Shiba Inu puppy. This will help him develop good habits and learn not to soil his surroundings. After he's toileted outside, you can start work on teaching him not to bite.
Start by establishing a positive relationship with your puppy. When he's calm and cooperative, reward him with treats or attention. Avoid scolding or discipline – these only confuse and frustrate your dog. Instead, calmly remove the things he's bitten, and give him another chance soon. If he continues biting, take away all privileges for a period of time – maybe a month or two – until he understands that biting is not acceptable behaviour.