You can continue swimming safely. Yes, the incidence of sinusitis is slightly higher in swimmers, especially if you dive down. But unless your sinusitis symptoms are too severe, just ignore. Finally, you have to decide.