For me it feels annoying that Server Manager always starts at login. OK, it is not bad when you are setting up the server, but later it is not neeeded.
So to disalbe the Server Manager automatic startup at login follow these steps:
Open Server Manager.
Go to Manage - Server Manager Properties
Select "Do not start Server Manager automatically at logon"