Brashear played in 79 games the following season, registering 19 assists and 28 points. After leading the Canucks in penalty minutes for the previous four seasons, Brashear was traded 31 games into the 2001–02 season to the Philadelphia Flyers. The Flyers received Brashear and the Canucks' sixth-round draft pick in 2002 in exchange for Jan Hlaváč and the Flyers' third-round pick in the same draft. While splitting time between the two franchises, Brashear set a career-high in points (32) while also amassing 199 PIMs. In 2002–03, he recorded eight goals, 25 points and 161 PIMs. Thanks in part to his strong work ethic, he was awarded the Pelle Lindbergh Memorial Trophy, an annual award given to the Flyers' most improved player. During the 2003–04 season, he was among the League leaders in PIMs, registering 212, ranking him fifth overall. His PIM total was aided by his role in the most penalized game in NHL history. On March 5, 2004, the Flyers were defeating the Ottawa Senators 5–2, when with 1:45 remaining in the game, Brashear fought Ottawa enforcer Rob Ray. The fight was believed to be in retaliation to Flyers forward Mark Recchi being slashed in the face by the Senators Martin Havlát. Following Brashear's fight, five separate brawls broke out. For his role in starting the fighting, Brashear was assessed 34 PIMs, more than any other Flyer. When asked later why he started the fighting, he responded by saying, "Why wouldn’t I? Did you see the last game?"