You can. They can be. Larger woofers produce more precise, space-filling bass and a greater "shake factor" than smaller models. This is just one aspect. For example, a large, poorly built subwoofer can rattle excessively, while smaller, more powerful models may still be able to do an excellent job.