There are a couple of ways of doing this.
1. Refer to http://support.veritas.com/docs/286729; this tells you about using BEMIG.EXE; then, you would have to use BEUtility to change the media server name in the database as described in http://support.veritas.com/docs/277063.
2. From your existing installation, tech note http://support.veritas.com/docs/274778 describes how to use BEUtility to Copy Media Server Configuration to a network location; then, on the new media server, you can use Apply Copied Media Server Configuration to bring back the jobs and setup.
For your information, tech note http://support.veritas.com/docs/283260 provides information about updating to 11d.