Do not set the From and To headers with setting custom headers.