Yes, it is okay to rev a cold engine. However, you should do so slowly and carefully to avoid damaging the engine.