Not only a bigger magnet but a well-built speaker is better. Along with bigger magnets, the coil, and cone should be able to play the frequencies well. All the parts of the speaker matter, not only the bigger magnet.  But a bigger magnet ensures a larger size of the driver where a coil can move deeper for deeper bass.