Only grow a rhythm if requested