PAct Official · Failure Taxonomy

Generated 2026-05-27T09:14:56.072660+00:00 · 9 samples · grouped by visual symptom and quantitative metric signal.
Data contract: Source GT = benchmark_100_manifest.json raw/source SDF stats; Raw GT = source-faithful SDF + raw mobility sidecar axes when available; PAct output = exported articulated object.json。机器可读证据:report.json

Failure Classes

分类依据不是原始标题,而是 3D 视觉差异、part/joint count、joint F1、joint type accuracy、axis error 和 scale consistency 的组合。

C. Thin structure / cross-source articulation failure

剪刀类薄结构既考验 part mask,也考验对非 PM 数据的 articulation 先验。

薄片结构,scale consistency 很低,axis=90,F1=0。
D. OOD scale-correspondence issue

跨源窗户不是纯失败,更像几何尺度与 part correspondence 没对齐。

count/type/axis 基本可用,但 joint F1 和 scale consistency 偏低。
#sampleprimary classsecondary signalpart/joint MAEF1axisscale
#73复杂物体 / high part countpart 对了,运动学绑定错many-part prismatic collapse0 / 80.07724.2°0.601
#19OOD / GRScenes window轴向基本对,但尺度/对应不稳partial success0 / 00.3332.3°0.437
#72自遮挡 / 多 movable遮挡/密集小件被漏或合并internal movable recall0 / 40.2222.2°0.738
#35薄小 part / scissors薄结构跨域失败thin part articulation0 / 1090°0.249
#58关节参数错配part 对了,运动学绑定错prismatic→revolute substitution0 / 0090°0.613
#62mask ablation 原始 mask清晰单轴正例clean single revolute0 / 010.53
#4拓扑 / part 合并遮挡/密集小件被漏或合并small dense part merge3 / 40.3338.8°0.723
#67简单样本回归part 对了,运动学绑定错continuous substitution0 / 0090°0.605
#22纹理 / 外观歧义part 对了,运动学绑定错texture/thin panel ambiguity0 / 0090°0.286
#sampleSource GTRaw GTPAct outputscorejoint F1axis°
1PartNetMobility/electronics/381133 links / 32 joints / 30 movable31 parts / 30 joints / 30 movable31 parts / 30 joints / 25 movable44.30.07724.167
2GRScenes/architectural_fixtures/grscenes_window_836a30a6ddbf_ef632e5 links / 4 joints / 3 movable4 parts / 3 joints / 3 movable4 parts / 3 joints / 3 movable52.520.3332.286
3PartNetMobility/major_appliances/28314 links / 13 joints / 11 movable12 parts / 11 joints / 11 movable12 parts / 11 joints / 8 movable52.60.2222.195
4ArtVIP/household_items/model_scissors_234 links / 3 joints / 2 movable3 parts / 2 joints / 2 movable3 parts / 2 joints / 1 movable35.5090
5PartNetMobility/small_appliances/34834 links / 3 joints / 1 movable2 parts / 1 joints / 1 movable2 parts / 1 joints / 1 movable41.26090
6PartNetMobility/small_appliances/14364 links / 3 joints / 1 movable2 parts / 1 joints / 1 movable2 parts / 1 joints / 1 movable82.0510
7GAPartNet/small_appliances/10310114 links / 13 joints / 11 movable12 parts / 11 joints / 11 movable9 parts / 8 joints / 8 movable51.770.3338.763
8PartNetMobility/household_fixtures/9154 links / 3 joints / 1 movable2 parts / 1 joints / 1 movable2 parts / 1 joints / 1 movable41.13090
9ArtVIP/household_items/model_folder_253 links / 2 joints / 1 movable2 parts / 1 joints / 1 movable2 parts / 1 joints / 1 movable36.09090

A. Part count correct, joint semantics wrong

PAct 能重建外形/part 数,但从 part 到 joint type、axis、range 的绑定不稳定。

1. 复杂物体 / high part count

#73 · PartNetMobility/electronics/3811 · PartNetMobility/electronics

3D GT vs PAct
hard_motion known_quality_or_conversion_issue many_parts part_decomposition prismatic_motion single_view_conditioning
Primary classmany-part prismatic collapse
视觉现象PAct 右侧保留了大量零件,但开合后出现许多门/旋钮式转动;Raw GT 是一组密集 prismatic 滑动件。
量化证据part MAE=0,joint MAE=8,joint F1=0.077,type acc=0.233;30 个 GT prismatic 只保住 7 个 prismatic。
建模含义需要把 joint decoding 从独立 part 属性改成 part graph 上的结构化约束。

Counts

countjoint types
Source GT33 links / 32 joints / 30 movablefixed:2, prismatic:30, revolute:0
Raw GT31 parts / 30 joints / 30 movablefixed:1, prismatic:30
PAct output31 parts / 30 joints / 25 movablecontinuous:3, fixed:6, prismatic:7, revolute:12, screw:3

Eval Metrics

score44.3
part MAE0
joint MAE8
joint F10.077
axis deg24.167
origin0
Input
closed/rest
mid
open/end
Raw GT
input RGB
d=+0.00m
d=+0.45m
d=+0.89m
PAct
same input
θ=0°
θ=180°
θ=360°

Checks

  • Source GT links=33 与 Raw GT viewer parts=31 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • movable joint 数不同:Raw GT=30,PAct=25。
  • joint type 分布不同:Raw GT=fixed:1, prismatic:30;PAct=continuous:3, fixed:6, prismatic:7, revolute:12, screw:3。

Raw GT movable joints (top abs range)

idnametyperangeopen
24link_24prismatic[0, 0.89]0.89
25drawerprismatic[0, 0.89]0.89
26drawerprismatic[0, 0.89]0.89
27drawerprismatic[0, 0.89]0.89
28drawerprismatic[0, 0.89]0.89

PAct output movable joints (top abs range)

idnametyperangeopen
6knobcontinuous[0, 360]6.2832
8knobcontinuous[0, 360]6.2832
30knobcontinuous[0, 360]6.2832
17doorrevolute[0, 106.4952]1.8587
13doorrevolute[0, -87.6358]-1.5295

5. 关节参数错配

#58 · PartNetMobility/small_appliances/3483 · PartNetMobility/small_appliances

3D GT vs PAct
hard_motion internal_or_occluded_part_risk known_quality_or_conversion_issue part_decomposition prismatic_motion single_view_conditioning
Primary classprismatic→revolute substitution
视觉现象Raw GT 是小型滑动/抽拉件,PAct 视觉上变成大幅旋转开盖。
量化证据part/joint count 都对,但 type acc=0,F1=0,axis=90;GT prismatic 被预测成 revolute。
建模含义count 正确不能代表 articulation 正确;需要把 prismatic/revolute 类型判别单独约束。

Counts

countjoint types
Source GT4 links / 3 joints / 1 movablefixed:2, prismatic:1, revolute:0
Raw GT2 parts / 1 joints / 1 movablefixed:1, prismatic:1
PAct output2 parts / 1 joints / 1 movablefixed:1, revolute:1

Eval Metrics

score41.26
part MAE0
joint MAE0
joint F10
axis deg90
origin0
Input
closed/rest
mid
open/end
Raw GT
input RGB
same GT render
same GT render
same GT render
PAct
same input
θ=0°
θ=36°
θ=72°

Checks

  • Source GT links=4 与 Raw GT viewer parts=2 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • joint type 分布不同:Raw GT=fixed:1, prismatic:1;PAct=fixed:1, revolute:1。
  • GT closed/mid/open 三帧完全相同;这组静态状态图不可作为开合证据。

Raw GT movable joints (top abs range)

idnametyperangeopen
0doorprismatic[0, 0.3]0.3

PAct output movable joints (top abs range)

idnametyperangeopen
0doorrevolute[0, 72.1715]1.2596

8. 简单样本回归

#67 · PartNetMobility/household_fixtures/915 · PartNetMobility/household_fixtures

3D GT vs PAct
hard_motion known_quality_or_conversion_issue part_decomposition revolute_motion single_view_conditioning
Primary classcontinuous substitution
视觉现象简单一门样本中 PAct 外形数目对,但运动语义像无约束 continuous,而不是目标 revolute。
量化证据part/joint count 都对,type acc=1 但 F1=0,axis=90,PAct type=continuous。
建模含义简单样本仍会在 axis/correspondence 上失败,不能只靠复杂度解释错误。

Counts

countjoint types
Source GT4 links / 3 joints / 1 movablefixed:2, prismatic:0, revolute:1
Raw GT2 parts / 1 joints / 1 movablefixed:1, revolute:1
PAct output2 parts / 1 joints / 1 movablecontinuous:1, fixed:1

Eval Metrics

score41.13
part MAE0
joint MAE0
joint F10
axis deg90
origin0
Input
closed/rest
mid
open/end
Raw GT
input RGB
same GT render
same GT render
same GT render
PAct
same input
θ=0°
θ=180°
θ=360°

Checks

  • Source GT links=4 与 Raw GT viewer parts=2 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • joint type 分布不同:Raw GT=fixed:1, revolute:1;PAct=continuous:1, fixed:1。
  • GT closed/mid/open 三帧完全相同;这组静态状态图不可作为开合证据。

Raw GT movable joints (top abs range)

idnametyperangeopen
0buttonrevolute[0, 0.3644]0.3644

PAct output movable joints (top abs range)

idnametyperangeopen
1knobcontinuous[0, 360]6.2832

9. 纹理 / 外观歧义

#22 · ArtVIP/household_items/model_folder_25 · ArtVIP/household_items

3D GT vs PAct
cross_source_domain_gap known_quality_or_conversion_issue non_pm_generalization part_decomposition revolute_motion single_view_conditioning thin_structure
Primary classtexture/thin panel ambiguity
视觉现象文件夹薄面板被预测成大开盖/盒体式结构,视觉上打开方向和尺度都偏。
量化证据part/joint count 都对,type acc=1,但 F1=0,axis=90,scale=0.286。
建模含义纹理/薄板让 part correspondence 错位;需要约束活动面板与 hinge edge 的几何关系。

Counts

countjoint types
Source GT3 links / 2 joints / 1 movablefixed:1, prismatic:0, revolute:1
Raw GT2 parts / 1 joints / 1 movablefixed:1, revolute:1
PAct output2 parts / 1 joints / 1 movablefixed:1, revolute:1

Eval Metrics

score36.09
part MAE0
joint MAE0
joint F10
axis deg90
origin0
Input
closed/rest
mid
open/end
Raw GT
input RGB
θ=0° rest/folded
θ=-40°
θ=-80°
PAct
same input
θ=0°
θ=-35°
θ=-69°

Checks

  • Source GT links=3 与 Raw GT viewer parts=2 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • Raw GT revolute range=[-1.396, 0] rad;theta=0 是 rest/folded,负方向打开。

Raw GT movable joints (top abs range)

idnametyperangeopen
1knobrevolute[-1.3963, 0]-1.3963

PAct output movable joints (top abs range)

idnametyperangeopen
0doorrevolute[0, -69.1238]-1.2064

B. Hidden or dense movable recall failure

单视角下看不见的内部 movable 和拥挤小 part 是主要 recall 风险。

3. 自遮挡 / 多 movable

#72 · PartNetMobility/major_appliances/283 · PartNetMobility/major_appliances

3D GT vs PAct
hard_motion internal_or_occluded_part_risk known_quality_or_conversion_issue many_parts mixed_joint_types part_decomposition prismatic_motion revolute_motion
Primary classinternal movable recall
视觉现象外壳和大圆门/面板保住了,但内部微小 prismatic/被遮挡 movable 基本不可见,PAct 少了运动件。
量化证据movable 11→8,joint MAE=4,F1=0.222;axis=2.2° 说明匹配到的轴不差,主要是 recall。
建模含义需要显式建模不可见 movable 的先验,或引入多视角/仿真可达性信号。

Counts

countjoint types
Source GT14 links / 13 joints / 11 movablefixed:2, prismatic:9, revolute:2
Raw GT12 parts / 11 joints / 11 movablefixed:1, prismatic:9, revolute:2
PAct output12 parts / 11 joints / 8 movablecontinuous:4, fixed:4, prismatic:1, revolute:2, screw:1

Eval Metrics

score52.6
part MAE0
joint MAE4
joint F10.222
axis deg2.195
origin0.537
Input
closed/rest
mid
open/end
Raw GT
input RGB
θ=0°
rep. revolute θ=45°
rep. revolute θ=90°
PAct
same input
θ=0°
θ=180°
θ=360°

Checks

  • Source GT links=14 与 Raw GT viewer parts=12 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • movable joint 数不同:Raw GT=11,PAct=8。
  • joint type 分布不同:Raw GT=fixed:1, prismatic:9, revolute:2;PAct=continuous:4, fixed:4, prismatic:1, revolute:2, screw:1。
  • Raw GT 中 9 个 prismatic range 很小,2D 状态图主要由代表 revolute caption 主导。

Raw GT movable joints (top abs range)

idnametyperangeopen
0doorrevolute[-0, 1.5708]1.5708
6knobrevolute[-1.5708, 1.5708]1.5708
1buttonprismatic[0, 0.002]0.002
5buttonprismatic[0, 0.002]0.002
7buttonprismatic[0, 0.002]0.002

PAct output movable joints (top abs range)

idnametyperangeopen
8knobcontinuous[0, 360]6.2832
9knobcontinuous[0, 360]6.2832
10knobcontinuous[0, 360]6.2832
11knobcontinuous[0, 360]6.2832
6drawerrevolute[0, -28.9682]-0.5056

7. 拓扑 / part 合并

#4 · GAPartNet/small_appliances/103101 · GAPartNet/small_appliances

3D GT vs PAct
cross_source_domain_gap hard_motion internal_or_occluded_part_risk many_parts mixed_joint_types non_pm_generalization part_decomposition prismatic_motion
Primary classsmall dense part merge
视觉现象Raw GT 内部有多按钮/多旋钮;PAct 把按钮簇合并成更少的大块,右侧小 part 明显少。
量化证据parts 12→9,movable 11→8,part MAE=3,joint MAE=4,F1=0.333。
建模含义需要 cardinality loss、part query 排斥或后处理拆分,专门解决密集小 part 合并。

Counts

countjoint types
Source GT14 links / 13 joints / 11 movablefixed:2, prismatic:8, revolute:3
Raw GT12 parts / 11 joints / 11 movablefixed:1, prismatic:8, revolute:3
PAct output9 parts / 8 joints / 8 movablecontinuous:1, fixed:1, prismatic:1, revolute:5, screw:1

Eval Metrics

score51.77
part MAE3
joint MAE4
joint F10.333
axis deg8.763
origin0.295
Input
closed/rest
mid
open/end
Raw GT
input RGB
same GT render
same GT render
same GT render
PAct
same input
θ=0°
θ=180°
θ=360°

Checks

  • Source GT links=14 与 Raw GT viewer parts=12 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • movable joint 数不同:Raw GT=11,PAct=8。
  • joint type 分布不同:Raw GT=fixed:1, prismatic:8, revolute:3;PAct=continuous:1, fixed:1, prismatic:1, revolute:5, screw:1。
  • GT closed/mid/open 三帧完全相同;这组静态状态图不可作为开合证据。

Raw GT movable joints (top abs range)

idnametyperangeopen
8knobrevolute[-2.796, 2.8965]2.8965
9knobrevolute[-2.2934, 2.4944]2.4944
10knobrevolute[-0.8727, 0.8727]0.8727
0buttonprismatic[0, 0.004]0.004
1buttonprismatic[0, 0.004]0.004

PAct output movable joints (top abs range)

idnametyperangeopen
4knobcontinuous[0, 360]6.2832
2doorrevolute[0, -80.1418]-1.3987
3drawerrevolute[0, -71.3568]-1.2454
6doorrevolute[0, -40.2806]-0.703
5doorrevolute[0, -37.6631]-0.6573

C. Thin structure / cross-source articulation failure

剪刀类薄结构既考验 part mask,也考验对非 PM 数据的 articulation 先验。

4. 薄小 part / scissors

#35 · ArtVIP/household_items/model_scissors_23 · ArtVIP/household_items

3D GT vs PAct
cross_source_domain_gap non_pm_generalization part_decomposition revolute_motion single_view_conditioning thin_structure
Primary classthin part articulation
视觉现象剪刀薄片几何很小,PAct 能看到一些片状结构,但两个 blade 的运动关系和轴心基本没对上。
量化证据part MAE=0,但 movable 2→1,joint F1=0,axis=90,scale=0.249。
建模含义薄结构需要更高分辨率的 part evidence,以及对成对 revolute linkage 的先验。

Counts

countjoint types
Source GT4 links / 3 joints / 2 movablefixed:1, prismatic:0, revolute:2
Raw GT3 parts / 2 joints / 2 movablefixed:1, revolute:2
PAct output3 parts / 2 joints / 1 movablefixed:2, revolute:1

Eval Metrics

score35.5
part MAE0
joint MAE1
joint F10
axis deg90
origin0
Input
closed/rest
mid
open/end
Raw GT
input RGB
θ=0°
θ=10°
θ=20°
PAct
same input
θ=0°
θ=-28°
θ=-55°

Checks

  • Source GT links=4 与 Raw GT viewer parts=3 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • movable joint 数不同:Raw GT=2,PAct=1。
  • joint type 分布不同:Raw GT=fixed:1, revolute:2;PAct=fixed:2, revolute:1。

Raw GT movable joints (top abs range)

idnametyperangeopen
0e_scissors_2_1revolute[0, 0.3491]0.3491
1e_scissors_1_4revolute[0, 0.3491]0.3491

PAct output movable joints (top abs range)

idnametyperangeopen
0doorrevolute[0, -55.4495]-0.9678

D. OOD scale-correspondence issue

跨源窗户不是纯失败,更像几何尺度与 part correspondence 没对齐。

2. OOD / GRScenes window

#19 · GRScenes/architectural_fixtures/grscenes_window_836a30a6ddbf_ef632e · GRScenes/architectural_fixtures

3D GT vs PAct
cross_source_domain_gap hard_motion many_parts non_pm_generalization part_decomposition revolute_motion single_view_conditioning
Primary classpartial success
视觉现象窗户的关节方向基本合理,但 PAct 的尺寸、面板对应和打开幅度仍与 Raw GT 不一致。
量化证据part/joint count 都对,type acc=1,axis=2.3°;但 joint F1=0.333,scale=0.437。
建模含义OOD 源数据需要尺度归一、part correspondence 或渲染一致性约束,而不是只看轴角。

Counts

countjoint types
Source GT5 links / 4 joints / 3 movablefixed:1, prismatic:0, revolute:3
Raw GT4 parts / 3 joints / 3 movablefixed:1, revolute:3
PAct output4 parts / 3 joints / 3 movablecontinuous:1, fixed:1, revolute:2

Eval Metrics

score52.52
part MAE0
joint MAE0
joint F10.333
axis deg2.286
origin0.989
Input
closed/rest
mid
open/end
Raw GT
input RGB
θ=0°
θ=45°
θ=90°
PAct
same input
θ=0°
θ=180°
θ=360°

Checks

  • Source GT links=5 与 Raw GT viewer parts=4 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。
  • joint type 分布不同:Raw GT=fixed:1, revolute:3;PAct=continuous:1, fixed:1, revolute:2。

Raw GT movable joints (top abs range)

idnametyperangeopen
0group_4115236e_dc8c_4cbarevolute[0, 1.5708]1.5708
2group_b351fc1a_6aaf_463crevolute[0, 1.5708]1.5708
3group_bacc9198_80c9_4c2erevolute[0, 1.5708]1.5708

PAct output movable joints (top abs range)

idnametyperangeopen
3knobcontinuous[0, 360]6.2832
2doorrevolute[0, 84.6914]1.4781
1doorrevolute[0, -71.389]-1.246

E. Positive control

清晰单一 revolute、mask/part 简单时,PAct 可以给出可信运动学。

6. mask ablation 原始 mask

#62 · PartNetMobility/small_appliances/1436 · PartNetMobility/small_appliances

3D GT vs PAct
hard_motion internal_or_occluded_part_risk known_quality_or_conversion_issue part_decomposition revolute_motion single_view_conditioning
Primary classclean single revolute
视觉现象风扇/叶片类单轴运动,Raw GT 与 PAct 的结构和轴向最接近。
量化证据score=82.05,joint F1=1,type acc=1,axis=0。
建模含义这是 sanity check:简单清晰 revolute 条件下,现有 pipeline 可以工作。

Counts

countjoint types
Source GT4 links / 3 joints / 1 movablefixed:2, prismatic:0, revolute:1
Raw GT2 parts / 1 joints / 1 movablefixed:1, revolute:1
PAct output2 parts / 1 joints / 1 movablefixed:1, revolute:1

Eval Metrics

score82.05
part MAE0
joint MAE0
joint F11
axis deg0
origin0.343
Input
closed/rest
mid
open/end
Raw GT
input RGB
θ=0°
θ=45°
θ=90°
PAct
same input
θ=0°
θ=-25°
θ=-50°

Checks

  • Source GT links=4 与 Raw GT viewer parts=2 不同;viewer 使用有可视 mesh 的 source-faithful part 口径。

mask ablation metrics

variantscorepart MAEjoint F1
mask_orig_6282.0501
mask_maskzero_62020
mask_masknoise_6282.0401

Raw GT movable joints (top abs range)

idnametyperangeopen
0fanrevolute[-1.5708, 1.5708]1.5708

PAct output movable joints (top abs range)

idnametyperangeopen
1doorrevolute[0, -49.9098]-0.8711

原始页面:pact-official-failure-modes-20260525。本页只复用其样本资产,不复用其文字判断。