Differential Geometry provides a nice framework for creating neural nets.  Might be able to extend neural nets to arbitrary manifolds.