Hi gshawns.
This is an easy question.
All the remote servers must have installed the Backup Exec Remote Agent. Apart from that the Backup Exec Remote agent can be forced to publish information to the Media Server. This is the remote agent can be forced to explicity says to the Media Server "Hey I am here". If explicity publishing on the remote agents it is not enabled then you will see that tiny yellow icon.
For solving that go to one of the servers that it is marked with a tiny warning symbol and from the Start Menu select "Backup Exec Remote Agent Utility". A new screen will appear. Search for the tab "Publishing" and add to the list the name of the Media Server. Recycle the backup exec servicies and you will see that the yellow icon does not appear anymore.
Kind Regards.