Fix srcdir != builddir

This partially reverts commit 28b322ce4d583304d8ded89029440915a8176f08.

https://bugzilla.gnome.org/show_bug.cgi?id=732919