Thanks for the insight, everyone.
Right after I posted this, as a test, I did a restore from the same backup disk that was about 4 gigs in size so I could compare speed/times to the 27 MB restore job.
The 27 MB restore job took 45 mins - The 4 GB took... 48 mins.
My thinking on this is that when you restore a job, Backup Exec probably runs through the entire set of media, just to make sure that it didn't miss something.
My reasoning for this is that when you restore from Tape, the job seems to "check" through the entire tape, and I believe the logic would hold true on a Hard Disk, because Backup Exec doesn't seem to care that you're backing up to a hard drive - it works it just like its backing up to tape. It seems like it views the Hard Disk as just a big tape changer, and creates media "tapes" as it needs it in the hard disk folders.
That's my thoughts about it anyway. :)
Thanks again for the help!