Could you make this say "Choose folder..." initially (you could put that entry in the .ui file)?  It's a bit weird selecting your home directory from the list and then having a file dialog appear.