[MRG] Do not set Referer by default when its value is None

Another implementation for #473, alternative #474. 

closes #473.