PdbNavigator: how to clear SymbolsDownloaderCached

I am experimenting with symbol servers and the PdbNavigator has started defaulting to a site that is no longer configured. The only place I can find reference to the site is the SymbolsDownloaderCached. How do I remove items from this cache?