Make sure we don't use any extra information from the input masks