Extreme scale variation
The same semantic class can occupy a few pixels or dominate an entire region.
Ultra-wide area segmentation
Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation
See the detail. Keep the context. SFR-Net aligns local, short-range, and long-range observations around one projection reference point, then fuses them into a continuous semantic view.
— Code refreshed, known bugs fixed, and trained weights released for all three supported datasets.
Get weights01 · Motivation
Ultra-wide area images combine fine spatial detail with city-scale coverage. Patch-only models see fragments; aggressive resizing erases small objects. The hard part is preserving both.
The same semantic class can occupy a few pixels or dominate an entire region.
Independent patches lose long-range structure at roads, rivers, boundaries, and settlements.
Context must grow without feeding the full multi-gigapixel scene into the network.
02 · Method
SFR-Net samples aligned observations, identifies each range with learnable scale embeddings, and uses cascaded cross-scale fusion to progressively enrich the local representation.
Center every observation on the same projection reference point.
Add learnable scale embeddings after resizing observations to a common resolution.
Cascade cross-scale context toward the local branch while preserving detail.
03 · Performance
The paper reports state-of-the-art segmentation quality on GID and FBPS, with the largest gains where scale variation and semantic discontinuity matter most.
GID · mIoU
74.67+1.72paper resultGID · OA
86.94+1.09paper resultFBPS · mIoU
77.24+4.29paper resultFBPS · OA
92.91+2.40paper result04 · Qualitative results
Explore full-scene predictions. SFR-Net improves global consistency while retaining fine structures in dense, heterogeneous regions.
05 · Interactive demo
Choose one of five ultra-wide scenes, then zoom or drag either pane. The original image and SFR-Net prediction stay perfectly synchronized.
06 · Ablations
Switch between the core studies to inspect transferability, cascaded fusion, feature quality, and overlap robustness.
Adding scale-frustum representations produces large mIoU gains for PSPNet, DeepLabv3+, and UperNet. The convergence view shows the advantage persists through training.
Cascaded fusion improves both datasets, while the feature maps reveal sharper edges and cleaner foreground-background separation.
The smallest gap among compared methods indicates that SFR-Net learns stronger internal semantic continuity across patch boundaries.
07 · Model release
Download pretrained backbones and released checkpoints for GID, FBPS, and Inria Aerial. Released checkpoint metrics were reproduced with random seed 42 and therefore differ slightly from the paper.
Open on Hugging Face08 · Citation
If this project supports your research, please cite the paper and star the repository.
@article{zhong2026sfr,
title={SFR-Net: Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation},
author={Zhong, Chuyu and Chen, Keyan and Yang, Qinzhe and Chen, Bowen and Zou, Zhengxia and Shi, Zhenwei},
journal={arXiv preprint arXiv:2605.25737},
year={2026}
}
One more thing
If you find this repository helpful, please give it a star. Finally, here is Phoebe. You are not allowed to bully her.
Star SFR-Net