Revert #22.

This causes tests to build every time and other bad effects.
Merge pull request #40 from metajack/revert-skia-dep

Revert #22.