joystick: Don't crash when 0 joysticks exist on a port

* Interestingly, my SIXAXIS controller shows up in
  the window as usb/0 when plugged.