SceneTransporter · experiment detail
2026-04-19 23:59:30 UTC

SceneTransporter-style Assignment -> PAct Bridge

把 SceneTransporter 的核心思想真正接到了下游部件生成上:先用 `KMeans` 或 `OT+edge` 做 patch-to-part assignment,导出 `mask.exr`,再送进官方 PAct 推理链。4 个 PartNeXt 样例上,两种前端都把 `part count` 稳住了,`mean_part_count_abs_error = 0.00`;但 `OT+edge` 目前只带来了局部语义变化,还没有系统性打赢 KMeans。这说明论文里的 assignment 思想是能桥接到部件生成前端的,但如果没有 compositional latent 和生成环内 routing,仅靠前端 mask 重写还不够把 PAct 的跨域语义漂移彻底拉回来。

SceneTransporterPActPartNeXtbridgeOTpart-generation
2026-04-19 23:59:30 UTCTimestamp
4Assets
activeStatus
SceneTransporter-style Assignment -> PAct Bridge cover image
Assets
Interactive Asset

Knife_00602ef508784e5384665aacaaf1f3a0

GT coarse parts 是 `Blade / Handle`,两种前端都把槽位数稳在 `2`。KMeans 下游输出 `base / drawer`,OT+edge 下游输出 `base / drawer`。OT 与 KMeans 的下游语义结果相同。

2 -> 2GT / OT pred parts
base / drawerKMeans pred names
base / drawerOT pred names
F + ROT pred joints
Knife_00602ef508784e5384665aacaaf1f3a0 Rendered input image
Rendered input image
Knife_00602ef508784e5384665aacaaf1f3a0 GT coarse part overlay
GT coarse part overlay
Knife_00602ef508784e5384665aacaaf1f3a0 KMeans part boundaries
KMeans part boundaries
Knife_00602ef508784e5384665aacaaf1f3a0 OT+edge part boundaries
OT+edge part boundaries
Knife_00602ef508784e5384665aacaaf1f3a0 KMeans patch assignment overlay
KMeans patch assignment overlay
Knife_00602ef508784e5384665aacaaf1f3a0 OT+edge patch assignment overlay
OT+edge patch assignment overlay
Knife_00602ef508784e5384665aacaaf1f3a0 · OT+edge predicted assembled object
默认 viewer 是 SceneTransporter 风格 OT+edge 前端送入 PAct 后导出的整物体;下载区同时保留 KMeans 基线结果。
Interactive Asset

Toilet_01b31c7fb7bd41ac8019ffc994b22b60

GT coarse parts 是 `Tank / Toilet Lid / Toilet Base`,两种前端都把槽位数稳在 `3`。KMeans 下游输出 `door / base / base`,OT+edge 下游输出 `door / handle / base`。OT 语义从 `door / base / base` 改成了 `door / handle / base`。

3 -> 3GT / OT pred parts
door / base / baseKMeans pred names
door / handle / baseOT pred names
R + F + FOT pred joints
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 Rendered input image
Rendered input image
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 GT coarse part overlay
GT coarse part overlay
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 KMeans part boundaries
KMeans part boundaries
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 OT+edge part boundaries
OT+edge part boundaries
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 KMeans patch assignment overlay
KMeans patch assignment overlay
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 OT+edge patch assignment overlay
OT+edge patch assignment overlay
Toilet_01b31c7fb7bd41ac8019ffc994b22b60 · OT+edge predicted assembled object
默认 viewer 是 SceneTransporter 风格 OT+edge 前端送入 PAct 后导出的整物体;下载区同时保留 KMeans 基线结果。
Interactive Asset

Monitor_01ce620e70ff40708eb4a1b04f4a828e

GT coarse parts 是 `Display / Stand`,两种前端都把槽位数稳在 `2`。KMeans 下游输出 `drawer / base`,OT+edge 下游输出 `drawer / base`。OT 与 KMeans 的下游语义结果相同。

2 -> 2GT / OT pred parts
drawer / baseKMeans pred names
drawer / baseOT pred names
R + FOT pred joints
Monitor_01ce620e70ff40708eb4a1b04f4a828e Rendered input image
Rendered input image
Monitor_01ce620e70ff40708eb4a1b04f4a828e GT coarse part overlay
GT coarse part overlay
Monitor_01ce620e70ff40708eb4a1b04f4a828e KMeans part boundaries
KMeans part boundaries
Monitor_01ce620e70ff40708eb4a1b04f4a828e OT+edge part boundaries
OT+edge part boundaries
Monitor_01ce620e70ff40708eb4a1b04f4a828e KMeans patch assignment overlay
KMeans patch assignment overlay
Monitor_01ce620e70ff40708eb4a1b04f4a828e OT+edge patch assignment overlay
OT+edge patch assignment overlay
Monitor_01ce620e70ff40708eb4a1b04f4a828e · OT+edge predicted assembled object
默认 viewer 是 SceneTransporter 风格 OT+edge 前端送入 PAct 后导出的整物体;下载区同时保留 KMeans 基线结果。
Interactive Asset

Guitar_553a53ba86804d4da6e51946a6011b0e

GT coarse parts 是 `String Components / Guitar Main Components`,两种前端都把槽位数稳在 `2`。KMeans 下游输出 `base / drawer`,OT+edge 下游输出 `base / base`。OT 语义从 `base / drawer` 改成了 `base / base`。

2 -> 2GT / OT pred parts
base / drawerKMeans pred names
base / baseOT pred names
F + FOT pred joints
Guitar_553a53ba86804d4da6e51946a6011b0e Rendered input image
Rendered input image
Guitar_553a53ba86804d4da6e51946a6011b0e GT coarse part overlay
GT coarse part overlay
Guitar_553a53ba86804d4da6e51946a6011b0e KMeans part boundaries
KMeans part boundaries
Guitar_553a53ba86804d4da6e51946a6011b0e OT+edge part boundaries
OT+edge part boundaries
Guitar_553a53ba86804d4da6e51946a6011b0e KMeans patch assignment overlay
KMeans patch assignment overlay
Guitar_553a53ba86804d4da6e51946a6011b0e OT+edge patch assignment overlay
OT+edge patch assignment overlay
Guitar_553a53ba86804d4da6e51946a6011b0e · OT+edge predicted assembled object
默认 viewer 是 SceneTransporter 风格 OT+edge 前端送入 PAct 后导出的整物体;下载区同时保留 KMeans 基线结果。