Use .concatenate instead of .horizontal_stack. Also assume input state information already has bias values appended.