Make sure Quicksilver dir exists