Beyond them were the tribes of the native Ainu, at that time not considered Japanese. 
The Ainu tribes were not considered to be Japanese.
mnli hypothesis: The Ainu tribes were not considered to be Japanese. premise: Beyond them were the tribes of the native Ainu, at that time not considered Japanese. 