That is indeed possible. Nintendo Switch Online is optional for most game types (Smash, Spirits, Vaults, Games & More). These game types let you play alone or locally with other people.