Yes, the effects of the bone shard after using them at the Firelink Shrine are permanent. As soon as you get a shard, you should go to the firelink shrine and increase the potency of your Estus Flask. This will make the player's life much easier.