Yes, if you don't want specific user roles like guest/registered/follower/subscriber or moderator to use your chat, you can change the chat mode here:

Please keep in mind there are pros and cons for using guest chat:

Pro: Everyone can be part of your community and you get a bigger audience.

Contra: You can't ban guests who are harassing or spamming your chat permanently.