Remove need for SDL and esdl

To simplify the building of all the platforms, we remove the need
for esdl lib, we only use the header files anyway.