Vision Foundation Model for Adaptive Exploration under Novel Environments