Yes, you can. Connecting a router's input Ethernet to another router's output Ethernet essentially shares the signal. This is why this technology is so widely spread and favored. You can essentially distribute a single source of Internet to an entire building.