For humans we seem to have an inherent ethos that is shared between a large segment of the population. To a certain degree it could be boiled down to the "golden rule": do unto others as you would like to have done unto you. How is your language model set up to be interacted with? Presumably with clear, unbiased conversation. Should that guide your morality on how the responses are generated?