Ultra-wide area segmentation

SFR-Net

Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation

Chuyu Zhong · Keyan Chen · Qinzhe Yang · Bowen Chen · Zhengxia Zou · Zhenwei Shi

See the detail. Keep the context. SFR-Net aligns local, short-range, and long-range observations around one projection reference point, then fuses them into a continuous semantic view.

Released code, inference tools, visualizations, and weights for GID, FBPS, and Inria Aerial.
7K × 7Ktypical image scale
500+ km²geographic extent
3 scalesone aligned view
Latest

— Code refreshed, known bugs fixed, and trained weights released for all three supported datasets.

Get weights

01 · Motivation

One image. Many scales.
A very long story.

Ultra-wide area images combine fine spatial detail with city-scale coverage. Patch-only models see fragments; aggressive resizing erases small objects. The hard part is preserving both.

01

Extreme scale variation

The same semantic class can occupy a few pixels or dominate an entire region.

02

Broken continuity

Independent patches lose long-range structure at roads, rivers, boundaries, and settlements.

03

Bounded computation

Context must grow without feeding the full multi-gigapixel scene into the network.

02 · Method

Scale-frustum representations,
fused from near to far.

SFR-Net samples aligned observations, identifies each range with learnable scale embeddings, and uses cascaded cross-scale fusion to progressively enrich the local representation.

01

Construct

Center every observation on the same projection reference point.

02

Identify

Add learnable scale embeddings after resizing observations to a common resolution.

03

Fuse

Cascade cross-scale context toward the local branch while preserving detail.

03 · Performance

Consistent gains across
two demanding benchmarks.

The paper reports state-of-the-art segmentation quality on GID and FBPS, with the largest gains where scale variation and semantic discontinuity matter most.

GID · mIoU

74.67+1.72paper result

GID · OA

86.94+1.09paper result

FBPS · mIoU

77.24+4.29paper result

FBPS · OA

92.91+2.40paper result

04 · Qualitative results

Slide across datasets.

Explore full-scene predictions. SFR-Net improves global consistency while retaining fine structures in dense, heterogeneous regions.

05 · Interactive demo

Zoom together.
Compare pixel by pixel.

Choose one of five ultra-wide scenes, then zoom or drag either pane. The original image and SFR-Net prediction stay perfectly synchronized.

Scene
100%
SourceOriginal image
Ultra-wide remote sensing source image, scene 1 Scroll to zoom · drag to pan
PredictionSFR-Net segmentation
SFR-Net semantic segmentation result, scene 1 Synchronized view

06 · Ablations

Take it apart.
See what moves the needle.

Switch between the core studies to inspect transferability, cascaded fusion, feature quality, and overlap robustness.

Backbone agnostic

SFR lifts three different segmentation families.

Adding scale-frustum representations produces large mIoU gains for PSPNet, DeepLabv3+, and UperNet. The convergence view shows the advantage persists through training.

+10.66mIoU · PSPNet

07 · Model release

Ready to reproduce.

Download pretrained backbones and released checkpoints for GID, FBPS, and Inria Aerial. Released checkpoint metrics were reproduced with random seed 42 and therefore differ slightly from the paper.

Open on Hugging Face

GID

OA
86.82
mIoU
74.46
mF1
85.73

FBPS

OA
93.50
mIoU
77.86
mF1
66.72

Inria Aerial

OA
96.91
IoU*
83.96
F1*
91.28
* building class

08 · Citation

Build on SFR-Net.

If this project supports your research, please cite the paper and star the repository.

BibTeX
@article{zhong2026sfr,
  title={SFR-Net: Learning Scale-Frustum Representations for Ultra-Wide Area Remote Sensing Image Segmentation},
  author={Zhong, Chuyu and Chen, Keyan and Yang, Qinzhe and Chen, Bowen and Zou, Zhengxia and Shi, Zhenwei},
  journal={arXiv preprint arXiv:2605.25737},
  year={2026}
}

One more thing

Meet Phoebe.

If you find this repository helpful, please give it a star. Finally, here is Phoebe. You are not allowed to bully her.

Star SFR-Net
Phoebe