In rare cases, a sore on the tongue could be a sign of oral cancer. However, most tongue sores are harmless and will go away on their own.