If your graham cracker crust is crumbly, it probably needs more butter, sugar, or a combination of the two. It's tempting to leave the sugar out of a graham cracker crust, noting there's sugar in the crackers themselves. However, adding sugar helps bind the crumbs together as the crust cools after baking. Additionally, using brown sugar can create a more tender crust, too.