This is the first I've heard of robots.txt being worthless. Google specifically says they support it. Be that as it may, your canonical URL approach is also good. How about a setting called `CANONICAL_URL`? That'd be nice and clear and wouldn't interfere with `SITE_URL`.