Yes. To connect to the Internet, an activate SIM is required that has data applied. If you are sending information to a WIFI device, like a printer, then you do not need to have a SIM card inserted.
Always turn your router off and on again after doing any adjustments to the SIM card. The router needs to re-read the SIM card once it has been inserted, so turning it off and on again will enable it to do this.