Don't call pkg-config on something we're building.

This produced an unsightly:
    No package 'sdl2' found
    <three more lines of spew>
four times; and possibly could lead to mixing headers and libraries
from the system version of the library with those from the contrib.