Don't try to optimize loopback fetches

Fixes #213