Added adjMatrix to start supporting spatial

Currently the matrix only supports a single connection in each
direction, but it should be easy to get it working for multiple
connections