I would like to be able to plant right into the compost and not have to add any soil to the compost. I've done this before. It's not necessarily safe to do so. There are things you need to consider, such as pH levels, nutrient needs, etc. You will want to test the pH of the compost. If it's low, you may want to add something acidic such as peat moss or wood ash to raise the pH a bit. You could also consider adding some limestone. You can fertilize the compost and then spread it out over the garden bed. It won't hurt anything, but it might not be exactly what you want. You'll have to make sure you get the amount of fertilizer you want.