Login to your router's administrative console and look for a page called Security or Firewall. If this is present, your router has a firewall.