Absolutely. Pregnancy isn’t considered a pre-existing condition, so travel insurance when pregnant shouldn’t cost you any more than usual.
But you won’t be covered if you fly against medical advice and might not be covered if you give birth abroad.
You might want to check your policy to see if it covers holiday cancellation or curtailment due to pregnancy complications. Also, see what medical cover you have, just in case baby arrives sooner than expected.