You don't pay motor tax on an electric bicycle. You don't have to have insurance either.
However, you may wish to insure your bicycle against theft or accidental damage. This can be purchased online from less than €15 per month depending on the value of your bicycle. See Bikmo or Blue Insurance for more information.