only set Response.urls_to_activity when it's non-empty