Defeating Margaret in Persona 4 will grant you a ton of experience and money that will be useful in the rest of the game. In addition, you will receive the Spiral Bookmark item. With this, you can return to the Velvet Room in the future and speak with her to receive the special Deep Blue costume.