The Single Reference, Primary, and Reference time servers are all time source servers. That is, they provide time to the network. Secondary servers do not provide a time to other servers; they only receive a time from a time source server. (They do, however, provide time to client workstations.)
Time source servers use one of two methods to find each other: SAP or custom configuration.