Yes, you can delete or remove your Now Playing song history by navigating to Settings app >> Sound & vibration >> Now Playing >> Now Playing history >> Tap on the three-dots icon at the top >> Remove All >> Confirm it by tapping on Remove.