Walleye like to feed on yellow perch, minnows, crayfish, and insects. Walleye tend to bite best at dawn or dusk. They rarely swim during the day unless there are very overcast conditions.