Yes. A filter can be too small for a fish tank. For instance, if the filter is not rated for the size of your tank, it may not be able to clean the water properly. This can cause a number of problems, including decreased water quality and an increase in algae growth. Additionally, if the filter is too small, it may not be able to handle the amount of waste produced by the fish in your tank, which can also lead to poor water quality.