Three of these children were brought upstairs to live with Fritzl and his wife Rosemarie , but the other three remained in the cellar with their mother , never seeing daylight until their release in late April .