Yes, you can use only all-purpose flour, but the texture and flavor might differ slightly from the original Cheesecake Factory brown bread, which benefits from the added whole wheat flour.