GeoSURGE: Geo-localization using Semantic Fusion with Hierarchy of Geographic Embeddings

Worldwide visual geo-localization seeks to determine the geographic location of an image anywhere on Earth using only its visual content. Learned representations of geography for visual geo-localization remain an active research topic despite much progress. We formulate geo-localization as aligning the visual representation of the query image with a learned geographic representation. Unlike prior work, our geographic representation explicitly models the world as a hierarchy of learned geographic embeddings. Additionally, we introduce an approach to efficiently fuse the appearance features of the query image with its semantic segmentation map, forming a robust visual representation. Our main experiments demonstrate improved all-time bests in 22 out of 25 metrics measured across five benchmark datasets compared to prior state-of-the-art (SOTA) methods. Additional ablation studies support the claim that these gains are primarily driven by the combination of geographic and visual representations.