Turns out that the package is still EF 5.0.0 when you want 4.4 on .Net 4.0.