No. If your device is automatically connected to the Bluetooth tracker, then you won’t be kicked off the device for as long as you are synced to it. If the device isn’t actively paired with your phone, then anyone who syncs to it will be joined instead of yourself. You can always resync the Bluetooth connection once you are back within signal range and no one else is connected to it.