It may be considered a fetish if you are only attracted to disabled people, and this type of fetish is called devotism. However, there might be other reasons why you are attracted to them, like growing up with disabled parents or siblings.