PERF: safeguard to ensure similarity search does not fire too much
HACK: to be fixed later by @eviltrout