Are you running Raring? Let's recommend Saucy. Once 14.04 LTS comes out with a kernel that supports Docker that's what we should recommend long term.