The name 'Tongue' derives from the Old Norse 'tunga', which means a 'point of land'. There is also a peninsula in the area, which might have given rise to the name.