Yes, you can still ride your bike with a dynamo even if the lights aren't turned on. However, it's important to remember that using lights on your bike is a legal requirement in many countries and it's always a good idea to be visible to other road users.