Yes, after installing the agent on a server you wish to monitor, you should also register that on the Zabbix server. However, you can do this by logging in to the Zabbix server web interface.
The address you can use are:
http://zabbix_server_name
or
https://zabbix_server_name