It is normal behavior. It takes a few minutes for the LED to switch off in the rear light after disconnecting, since an internal capacitor holds the LED switched on when the battery is switched off.