Friendship hearts with villagers can decay if you don't interact with them. If you don't talk to a villager, their friendship points will slowly decrease, but daily gifting and regular interaction can prevent this.