Definitely don't glue in the dowels as this unit is a bit tricky to put together.  You may have to take some section of it apart at one point during construction.  Also one side bowed a bit, making the cam screws difficult to attach.  Looks nice once put together.