Remove workaround for vala <0.23.2, fixes bug 723822

The old workaround causes reading/writing from invalid pointers,
when compiled with 0.23.2.