User Agent can be set - I think it is important for clients of CKAN to identify themselves to the server. Plenty of times we have had a rogue bot calling the DGU API incessently. And it helps to know what is calling when exceptions occur.