You can right-click on the playlist cover and select 'Properties' (on desktop) or tap on the three vertical dots and select 'Share' (on mobile). The image's dimensions will be visible in the properties/share window.