Setting up a KMS server involves installing the KMS host key on a server running a supported Windows version, configuring the DNS records, and activating the KMS server with Microsoft. Once set up, client machines can connect to this server for activation by ensuring they are on the same network or have proper access.