In the past, I've had to grant myself rights to open other archives...using archive explorer. I've since removed those rights, but these mailboxes and folders are still being listed in the left pane of AE. I can't get to them anymore...but they're still listed. I have tried creating a new Outlook profile, but they still persist.
Did you sync the specific mailbox whose archive you see, and ticked the "Folder hierarchy and permissions" box?
Open properties of the specific mailbox archiving task, tab Synchronization, Selected mailboxes, tick mentioned box, click Synchronize.
Select the mailbox, sync.
Then in your Outlook, in the pane where you see the archive, rightclick, renew