Olive oil works just the same on semi-permanent dyes as on permanent ones. In fact, as it's quicker and easier to wash out semi-permanent dyes, you'll likely notice the olive oil's impact faster.