Hm, I think the regex may need some more work:
```vim
echo substitute('xx"bla\"bluu"xx', '".\{-}[^\\"]\?"\|''.\{-}[^\\'']\?''', '', 'g')
```
Yields `xxbluu"xx` instead of `xxxx`.