数据工程与质量 · Data Engineering and Quality

近半年 UMI 数据质量

UMI Data Quality

更新于

30 秒结论

先读这个判断

版本说明:本轮以 15 篇可获取完整正文的论文为论证主干,逐篇核对问题、方法、结果与限制;未能取得可读全文的论文不再承担正文结论。

精读论文
15
正式证据事件
15
知识单元
EA-DATA, EA-SENSOR, EA-HARDWARE, EA-XEMBODIMENT
审计状态
当前结算 run 已通过仓库校验

v0 · 完整正文

研究综述

研究边界

版本说明:本轮以 15 篇可获取完整正文的论文为论证主干,逐篇核对问题、方法、结果与限制;未能取得可读全文的论文不再承担正文结论。

本文覆盖 2026 年 1 月 14 日至 7 月 14 日公开论文,聚焦通用操作接口类数据在接触任务、三维感知和灵巧手迁移中的可用性。本次范围综述从 862 条去重候选中核验 122 篇可用全文,并以 20 篇直接相关论文形成判断。它仍不足以比较统一排行榜,也不能代表所有 UMI 设备与任务。

中心判断

UMI 数据质量的决定因素,正在从“是否便携、是否能大规模采集”转向“采集状态是否与部署机器人在物理上对齐”。视觉轨迹仍是可扩展基础,但在遮挡、接触和灵巧操作中,仅记录图像与位姿会丢失决定动作成败的深度、力矩、抓力和接触几何。接口越接近部署端的传感、末端和动作空间,数据越少依赖后续推断与重定向。

机制一:接触任务要求把力学状态带回数据

UMI-FT 的证据表明,野外柔顺操作需要同时记录力/力矩、深度、位姿和抓力。它隐含的边界很清楚:视觉与轨迹能描述“手去了哪里”,却难以说明接触是否稳定、物体是否滑移以及施力是否安全。

OmniUMI 进一步把 UMI 从视觉运动采集扩展为多模态物理交互。这里的增量不是多几个传感器字段,而是让示教记录包含动作后果。对于插入、擦拭和柔性物操作,力学状态决定同一轨迹究竟是成功动作还是危险动作。

机制二:三维感知决定可采场景边界

原始视觉方案在纹理丰富、遮挡有限的环境中高效,但动态变化、弱纹理、强遮挡和跟踪丢失会直接破坏位姿监督。UMI-3D 引入以激光雷达为中心的三维感知,核心价值不是让点云更漂亮,而是扩大可可靠采集的任务分布。

这也说明“质量”不能只在采完后评估。如果采集时关键物体已经失去跟踪,后处理很难恢复真实动作—场景关系。数据系统需要在线暴露跟踪置信度、遮挡比例和传感器退化,让采集员决定重采或切换模式。

机制三:采集硬件会塑造示教本身

夹爪设计研究 将人体工学、重量和力分布与示教速度、损伤风险和操作者负担联系起来。手持接口不是透明的数据管道;它会改变人怎样抓、怎样停顿以及怎样纠正。一个不舒适或力反馈失真的设备,会系统性制造模型随后要学习的动作偏差。

因此,UMI 质量验收应包含采集员侧指标:不同持续时长下的疲劳、动作抖动、任务完成时间、物体损伤和重复采集率。只检查文件完整与最终成功,会漏掉接口长期使用造成的分布漂移。

机制四:灵巧操作中,少做重定向就是质量

这条路线牺牲了一部分跨平台通用性,换来更强的物理一致性。它适合高价值、接触密集任务,却不意味着所有 UMI 都应绑定单一末端。更实际的分层是:通用接口负责场景与高层运动覆盖,同构末端数据负责精细接触落地。

条件、分歧与限制

五篇论文共同指出扩展方向,却没有证明传感器越多越好。深度、力矩和触觉会增加标定、同步、耐用性与成本问题;共享末端减少重定向,却降低跨本体复用。选择应由任务风险驱动:开放空间搬运与紧配合装配需要的状态完全不同。

本轮证据也缺少统一数据协议和跨设备闭环比较。论文分别验证柔顺操作、三维跟踪和灵巧手,但尚不能给出“增加某传感器必然提升多少成功率”的普遍结论。

下一步与结论

建议把 UMI episode 的验收拆成四层:轨迹与视频是否完整,关键状态是否可观测,采集接口是否引入人体工学偏差,数据能否映射到部署本体。每一层都应保存置信度与失败原因,并用真实策略表现回校。

UMI 的长期价值仍在低成本扩大交互覆盖,但下一阶段竞争不会只是设备更轻、采集更快,而是谁能用更少后处理保留真实物理关系。高质量 UMI 数据不是一条干净视频,而是一段可追溯、可重放、能在目标机器人上成立的交互。

数据规范建议

一个可复用的 UMI 记录应把原始传感与派生状态分开保存。原始层包括视频、深度、力矩、抓力和设备状态;派生层包括位姿、接触事件与动作片段,并保存算法版本与置信度。这样,跟踪算法升级后可以重新计算标签,而不必重新采集整批数据。

每个片段还应注明目标机器人、末端结构、控制频率和动作映射。若只保留统一轨迹而丢掉采集设备与部署本体的关系,后续团队无法判断误差来自示教、重定向还是控制器。对通用数据,可明确哪些字段跨本体共享;对专用数据,则记录同构末端带来的物理一致性优势。

质量抽检最好加入真实回放。选取遮挡、弱纹理、长时接触和操作者疲劳等高风险片段,让目标机器人复现,再比较轨迹、接触和结果。回放失败不一定意味着整条数据报废,却能暴露需要补采、降权或增加模态的具体位置。

从项目组合看,可以用通用 UMI 扩大任务和环境覆盖,再以少量高保真、多模态、同构末端数据校准接触阶段。这样的金字塔比所有数据都追求最高配置更可控,也比只依赖视觉轨迹更接近真实部署需求。

在采购与试采阶段,可先用两类对照任务检验设备:一类考察遮挡与三维跟踪,一类考察接触与力控制。若设备只能在第一类表现良好,就应把它定位为场景覆盖工具,而不是宣称可独立承担接触数据。清晰定位比堆叠功能更能避免后续数据返工。

这也是更稳妥的验收方式。

精读复核后的 UMI 数据边界

移出无完整正文支持的设备引用后,可读证据更清楚地把 UMI 质量拆成三层。第一层是接触可观测性:UMI-FT 用力/力矩、深度、位姿和时间对齐补足接触丰富操作;OmniUMI 把视觉中心的采集接口扩展为人类对齐的多模态互动。第二层是空间可观测性:UMI-3D 指出纯视觉 UMI 在遮挡、动态变化和弱纹理场景中容易失去稳定位姿。

第三层是生成数据的可信边界。RynnWorld-Teleop 用数字遥操作解耦操作者、硬件和 workspace,但论文同时明确报告它仍难处理精细流体、高形变物体,并且跨机器人平台仍需微调。因此,UMI 规模化的正确方向不是追求一个“通用采集器”,而是对视觉、接触、位姿和生成偏差分别建立验收门槛。

References

Accepted evidence

去重论文引用

  1. An Efficient Metric for Data Quality Measurement in Imitation LearningNoushad Sojib, Momotaz Begum · 2026
  2. Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration CollectionGokul Narayanan, Yash Shahapurkar, Melih Erdogan, Brian Zhu, Eugen Solowjow · 2026
  3. Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World ModelsHongyu Li, Wanjia Fu, Xiaoyan Cong, Zekun Li, Binghao Huang, Hanxiao Jiang, Xintong He, Yiqing Liang et al. · 2026
  4. From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday TasksRobin Beierling, Manuel Scheibl, Jonas Dech, Abhijit Vyas, Anna-Lisa Vollmer · 2026
  5. GigaWorld-1: A Roadmap to Build World Models for Robot Policy EvaluationGigaWorld Team, Angyuan Ma, Boyuan Wang, Bohan Li, Chaojun Ni, Guo Li, Guan Huang, Guosheng Zhao et al. · 2026
  6. Imitating What Works: Simulation-Filtered Modular Policy Learning from Human VideosAlbert J. Zhai, Kuo-Hao Zeng, Jiasen Lu, Ali Farhadi, Shenlong Wang, Wei-Chiu Ma · 2026
  7. In-the-Wild Compliant Manipulation with UMI-FTHojung Choi, Yifan Hou, Chuer Pan, Seongheon Hong, Austin Patel, Xiaomeng Xu, Mark R. Cutkosky, Shuran Song · 2026
  8. Influence of Gripper Design on Human Demonstration Quality for Robot LearningGina L. Georgadarellis, Natalija Beslic, Seonhun Lee, Frank C. Sup, Meghan E. Huber · 2026
  9. OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal InteractionShaqi Luo, Yuanyuan Li, Youhao Hu, Chenhao Yu, Chaoran Xu, Jiachen Zhang, Guocai Yao, Tiejun Huang et al. · 2026
  10. Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot LearningHaeone Lee, Taywon Min, Junsu Kim, Sinjae Kang, Fangchen Liu, Lerrel Pinto, Kimin Lee · 2026
  11. RynnWorld-Teleop: An Action-Conditioned World Model for Digital TeleoperationHaoyu Zhao, Xingyue Zhao, Hangyu Li, Biao Gong, Kehan Li, Siteng Huang, Xin Li, Deli Zhao et al. · 2026
  12. SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA ModelsChangti Wu, Bin Yu, Zhaolong Shen, Shijie Lian, Xiaopeng Lin, Cong Huang, Zhirui Zhang, Lei Zhang et al. · 2026
  13. TACO: TActile World Model as a Self-COrrector forScalable VLA Post-TrainingShengbang Liu, Yueru Jia, Yuyang Yan, Jiaming Liu, Xinran Zhang, Qiuxuan Feng, Yandong Guo, Shiji Zhou et al. · 2026
  14. UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial PerceptionZiming Wang · 2026
  15. WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data CurationJustin Yu, Andrew Goldberg, Kavish Kondap, Karim El-Refai, Ethan Ransing, Qianzhong Chen, Mac Schwager, Fred Shentu et al. · 2026
完整证据附录(15 条正式证据事件)
  • Time range: 2026-01-14..2026-07-14
  • Events: 15
  • 每个事件一节,标题即锚点;trace-map 中的 event 链接跳转到这里。

EA-UMI-READ-0011

  • Claim: 示教数据质量不应只用相似度、互信息或人工启发式代理指标定义;QoQ 将高质量轨迹定义为对目标验证示范 loss 降低和策略性能提升有直接贡献的数据。
  • Stance: support | Confidence: direct
  • Paper: 2603.09056 Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning
  • Locator: VI CONCLUSIONS
  • Evidence: 论文指出人类遥操作会带来错误、操作约束、技能差异、噪声和次优行为;QoQ 用 influence functions 衡量训练 state-action 对验证示范的贡献,并在轨迹层聚合以降低噪声、保持覆盖,在仿真、真实机器人和 DROID in-the-wild 数据上改善策略成功率。
  • Quote: “In this work, we propose QoQ, a method that curates robotic datasets based on direct performance contribution to the learned policy. We define a quality scoring mechanism for state-action pairs derived from influence functions.”
  • Authors: haeone-lee; taywon-min; junsu-kim; et al.

EA-UMI-READ-0001

  • Claim: 示教数据质量会被采集硬件本身塑形;UMI 类手持 gripper 的力分布、重量和人体工学会影响任务表现、操作者负担和后续可学习策略。
  • Stance: support | Confidence: direct
  • Paper: 2603.17189 Influence of Gripper Design on Human Demonstration Quality for Robot Learning
  • Locator: V DISCUSSION
  • Evidence: 论文指出 UMI 示教虽快于遥操作但仍比手工慢、工具重量会造成疲劳并影响 demonstration;实验中改变 UMI gripper fingers 的力分布显著影响打开绷带包装表现,concentrated load grippers 优于 distributed load grippers,作者将其连接到 demonstration quality 和 learned robot control policies。
  • Quote: “Overall, the usability study demonstrated that altering the force distribution of UMI gripper fingers significantly affected participants’ ability to open bandage packages, with concentrated load grippers outperforming distributed load grippers. These findings highlight that subtle hardware changes can substantially improve demonstration quality and, in turn, the robot control policies learned from them.”
  • Authors: gina-l-georgadarellis; natalija-beslic; seonhun-lee; et al.

EA-UMI-READ-0012

  • Claim: 面向部署环境的 end-user 示教,低质量常表现为过度纠正、振荡和突兀调整;轨迹功率谱密度 PSD 可作为无需 rollout、专家标签或重新训练的快速质量排序指标。
  • Stance: support | Confidence: direct
  • Paper: 2605.01544 An Efficient Metric for Data Quality Measurement in Imitation Learning
  • Locator: Abstract (full-text section)
  • Evidence: 论文把 poor-quality end-user demonstrations 具体化为 excessive corrective motions、oscillations 和 abrupt adjustments,并提出基于 demonstration trajectories PSD 的自动排序指标;实验比较未筛选、oracle、现有排序和 jerk/path-length 等 baseline,研究 PSD 筛选对下游 IL 成功率和平滑性的影响。
  • Quote: “Abstract Imitation learning (IL) has seen remarkable progress, yet field deployment of IL-powered robots remains hindered by the challenge of out-of-distribution (OOD) scenarios. Fine-tuning pre-trained policies with end-user demonstrations collected in deployment environments is a promising strategy to address this challenge. However, end-user demonstrations are frequently of poor quality, characterized by excessive corrective motions, oscillations, and abrupt adjustments that degrade both lear”
  • Authors: noushad-sojib; momotaz-begum

EA-UMI-READ-0013

  • Claim: DQAF 不用成功/失败二值标签代替数据质量,而是联合子任务进度、动作平滑度、停顿和运动学极限生成 episode 级评估与给操作者的纠正反馈。
  • Stance: support | Confidence: direct
  • Paper: 2605.26349 Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration Collection
  • Locator: Abstract (full-text section)
  • Evidence: 摘要明确列出了质量信号、结构化评估和可执行的自然语言反馈。
  • Quote: “Abstract Industrial automation is at a pivotal moment, as Physical AI is driving a transition from rigid, hand-engineered automation systems toward more flexible and adaptive systems. This shift has created a growing demand for large-scale, real-world robot demonstration data, making teleoperation an increasingly important mechanism for data collection. However, high-quality teleoperated demonstrations remain difficult to obtain in practice, as novice operators often produce episodes that are ta”
  • Authors: gokul-narayanan; yash-shahapurkar; melih-erdogan; et al.

EA-UMI-READ-0014

  • Claim: 数据质量必须经闭环评估定义;对机器人世界模型来说,短期视觉真实感不如长程、动作忠实的 rollout 一致性更能决定其作为策略评估器的可靠性。
  • Stance: support | Confidence: direct
  • Paper: 2607.02642 GigaWorld-1: A Roadmap to Build World Models for Robot Policy Evaluation
  • Locator: Abstract (full-text section)
  • Evidence: 论文指出真实机器人策略评估受硬件和人工监督限制,是基础模型迭代瓶颈;WMBench 用真实 teleoperation 数据和匹配 policy rollouts 构造评估,并分析 7 个视频世界模型、4 种动作表示和 324,000 余次模拟 rollout。其结论强调 evaluator 质量由长程 action-faithful rollout consistency、可迁移物理先验、动作编码、记忆和评估导向 post-training 共同决定。
  • Quote: “Using WMBench, we analyze 7 video world models, 4 action representation schemes, and over 324,000 simulated policy rollouts paired with real robot executions, further enriching our analysis with large-scale community submissions from the CVPR 2026 GigaBrain Challenge, curated synthetic trajectories, and a training videos spanning more than 12,000 hours. Our experiments deliver three core insights: evaluator quality is dominated by long-horizon, action-faithful rollout consistency rather than sho”
  • Authors: gigaworld-team; angyuan-ma; boyuan-wang; et al.

EA-UMI-READ-0015

  • Claim: 软物体和形变场景中的数据质量主要受可观测性约束:必须同时记录多视角全局运动、触觉局部形变和可用于评测的 3D 轨迹。
  • Stance: support | Confidence: direct
  • Paper: 2607.05390 Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models
  • Locator: Abstract (full-text section)
  • Evidence: 论文认为形变物体有高维状态和复杂材料属性,接触诱发的局部形变常被末端执行器或物体遮挡;已有数据集常缺对象多样性、依赖合成数据,或缺高保真标注与接触形变。Deform360 采集 198 个日常物体、1,980 个交互序列、215 小时以上数据、41 个环视相机和双臂触觉 UMI gripper,并用 markerless 3D tracking 提取稠密几何与运动。
  • Quote: “To address this, we present Deform360, a large-scale visuotactile dataset featuring 198 daily-life objects, 1,980 interaction sequences, and over 215 hours of observations from 41 surround-view cameras and bimanual tactile grippers to capture both global motion and contact-induced local deformations. Leveraging a novel markerless visuotactile 3D tracking pipeline to extract dense geometry and motion, we systematically evaluate current state-of-the-art world models, comparing 2D video models agai”
  • Authors: hongyu-li; wanjia-fu; xiaoyan-cong; et al.

EA-UMI-READ-0002

  • Claim: UMI-style data is useful for contact-rich manipulation when the collection interface records force/torque, depth, pose, and grasp-force signals; the paper also implies that vision/trajectory-only data is insufficient for force-sensitive tasks.
  • Stance: conditional | Confidence: direct
  • Paper: 2601.09988 In-the-Wild Compliant Manipulation with UMI-FT
  • Locator: Abstract (full-text section)
  • Evidence: The HTML full text reports that UMI-FT mounts compact six-axis force/torque sensors on each finger, uses multimodal demonstrations to train adaptive compliance policies, and shows diverse in-the-wild data outperforming limited scene-diversity data in a skewer task.
  • Quote: “Abstract Many manipulation tasks require careful force modulation. With insufficient force the task may fail, while excessive force could cause damage. The high cost, bulky size and fragility of commercial force/torque (F/T) sensors have limited large-scale, force-aware policy learning. We introduce UMI-FT, a handheld data-collection platform that mounts compact, six-axis force/torque sensors on each finger, enabling finger-level wrench measurements alongside RGB, depth, and pose. Using the mult”
  • Authors: hojung-choi; yifan-hou; chuer-pan; et al.

EA-UMI-READ-0008

  • Claim: VR 示教质量依赖交互模态和视觉表示,并且不同任务会偏好不同输入配置;采集系统优化不能只追求沉浸感或视觉保真。
  • Stance: conditional | Confidence: direct
  • Paper: 2602.10618 From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday Tasks
  • Locator: 1 Introduction
  • Evidence: 论文指出 VR 用于记录机器人学习示教时,visual fidelity 可能不如 user behavior 的 quality/reliability 重要;输入设备与可视化会影响工作负荷、运动效率、不必要动作和执行精度。实验发现 controller 与 motion-capture gloves 在 pick-and-place 与 manner-oriented tasks 上呈现不同轨迹策略和权衡。
  • Quote: “In contrast, when VR is used to record demonstrations for robot learning, visual fidelity may be less important than the quality and reliability of user behavior during task execution.”
  • Authors: robin-beierling; manuel-scheibl; jonas-dech; et al.

EA-UMI-READ-0009

  • Claim: 人类视频能扩大机器人学习数据来源,但其质量取决于机器人可执行性和任务兼容性;仿真过滤可把不可达、估计错误或 grasp 不兼容的轨迹排除或标注出来。
  • Stance: conditional | Confidence: direct
  • Paper: 2602.13197 Imitating What Works: Simulation-Filtered Modular Policy Learning from Human Videos
  • Locator: 3.3 Trajectory and Grasp Filtering via Simulation
  • Evidence: PSI 将人类演示转换为 6DoF object pose trajectories 后在仿真中执行,用于过滤不适合机器人学习的数据;不适合原因包括 pose estimation errors 和机器人 physically unachievable trajectories,并生成 grasp suitability labels 以学习 task-oriented grasping。
  • Quote: “Now that we have converted the human demonstrations into 6 DoF object pose trajectories, the next step is to execute them on a robot in simulation. This serves two purposes. One is to filter out those that may not be suitable for robot learning. There are two main reasons a trajectory may be unsuitable. First, pose estimation errors can lead to inaccurate trajectories. Second, the extracted trajectory may not be physically achievable by the robot. In either case, it would be harmful to train the”
  • Authors: albert-j-zhai; kuo-hao-zeng; jiasen-lu; et al.

EA-UMI-READ-0003

  • Claim: UMI-style data is a scalable foundation, but becomes substantially more useful for contact-rich tasks when upgraded from mainly visuomotor supervision to multimodal physical interaction data.
  • Stance: conditional | Confidence: direct
  • Paper: 2604.10647 OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal Interaction
  • Locator: Abstract (full-text section)
  • Evidence: The HTML full text repeatedly identifies limited physical interaction signals as a bottleneck of existing UMI-like systems and proposes synchronized RGB, depth, trajectory, tactile sensing, internal grasping force, and external wrench data to improve contact-rich policy learning.
  • Quote: “Abstract UMI-style interfaces enable scalable robot learning, but existing systems remain largely visuomotor, relying primarily on RGB observations and trajectory while providing only limited access to physical interaction signals. This becomes a fundamental limitation in contact-rich manipulation, where success depends on contact dynamics such as tactile interaction, internal grasping force, and external interaction wrench that are difficult to infer from vision alone. We present OmniUMI, a uni”
  • Authors: shaqi-luo; yuanyuan-li; youhao-hu; et al.

EA-UMI-READ-0010

  • Claim: 混合质量的长程示教不应粗粒度整条丢弃;次优 episode 里可能含有高价值恢复片段,质量控制需要下探到 frame/chunk 级别的进展信号。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.28320 WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation
  • Locator: Abstract (full-text section)
  • Evidence: 论文指出长程遥操作包含 pauses、fumbles 和 recoveries,整条 episode 过滤会丢失 otherwise suboptimal executions 中嵌入的 high-advantage segments,也无法剪掉保留示教中的局部 hesitation;WARP-RM 学习 dense relative progress 并用 WARP-BC upweight high-advantage action chunks。
  • Quote: “Abstract Scaling imitation learning requires large datasets, yet human teleoperation inevitably produces mixed-quality demonstrations containing hesitations and recoveries. Prior frame-level progress reward models supervise on absolute temporal progress proxies that suffer from label noise, or require costly human annotations to define subtask boundaries. We present WARP (Warp-Augmented Relative Progress), a novel fully self-supervised algorithm for learning dense, signed relative progress magni”
  • Authors: justin-yu; andrew-goldberg; kavish-kondap; et al.

EA-UMI-READ-0007

  • Claim: RynnWorld-Teleop将数字遥操作作为生成式数据引擎,但论文明确限定了它对精细流体动力学、高形变物体和跨机器人平台扩展的能力。
  • Stance: conditional | Confidence: direct
  • Paper: 2607.06558 RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation
  • Locator: 6 Conclusion
  • Evidence: 结论的限制段指出,模型在精细流体和高形变操作上仍会失败,而当前跨本体迁移仍要求每个平台单独微调。
  • Quote: “Limitation. While RynnWorld-Teleop successfully demonstrates digital teleoperation as a viable data engine, several limitations remain. First, while the depth-modulated rendering captures 3D spatial dynamics, the model occasionally struggles with complex physical phenomena such as fine-grained liquid dynamics or the manipulation of highly deformable objects. Addressing these cases will likely require richer training data covering such interactions. Second, bridging the embodiment gap currently r”
  • Authors: haoyu-zhao; xingyue-zhao; hangyu-li; et al.

EA-UMI-READ-0004

  • Claim: Original vision-only UMI data can fail to be useful in scenes with occlusion, dynamic changes, feature-poor regions, or tracking failure; adding LiDAR-centric 3D sensing improves data quality and expands the feasible task distribution.
  • Stance: limit | Confidence: direct
  • Paper: 2604.14089 UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception
  • Locator: Abstract (full-text section)
  • Evidence: The HTML full text states that monocular visual SLAM makes UMI vulnerable to occlusions, dynamic scenes, and tracking failures, and reports that LiDAR-centric SLAM improves pose-estimation robustness and demonstration data quality under challenging real-world conditions.
  • Quote: “Abstract We present UMI-3D, a multimodal extension of the Universal Manipulation Interface (UMI) for robust and scalable data collection in embodied manipulation. While UMI enables portable, wrist-mounted data acquisition, its reliance on monocular visual SLAM makes it vulnerable to occlusions, dynamic scenes, and tracking failures, limiting its applicability in real-world environments. UMI-3D addresses these limitations by introducing a lightweight and low-cost LiDAR sensor tightly integrated i”
  • Authors: ziming-wang

EA-UMI-READ-0005

  • Claim: TACO 用触觉感知世界模型联合预测未来视频和力序列,再将真实失败附近状态转成带纠正动作的想象片段,用于接触丰富任务的 VLA 后训练。
  • Stance: limit | Confidence: direct
  • Paper: 2607.02840 TACO: TActile World Model as a Self-COrrector forScalable VLA Post-Training
  • Locator: 5 Conclusion and Limitations
  • Evidence: 结论的 Recognize–Imagine–Label 回路明确连接了真实失败、视频—力联合想象与纠正动作标注。
  • Quote: “We presented TACO, a tactile-aware world-model-driven framework for scalable VLA post-training in contact-rich manipulation. Following a Recognize–Imagine–Label loop, TACO converts real-world failures into imagined corrections without repeated human intervention: a tactile-aware world model jointly denoises future video and force sequences, while a unified progress-action model recognizes failure-adjacent states and labels imagined segments with corrective actions. To incorporate this supervisio”
  • Authors: shengbang-liu; yueru-jia; yuyang-yan; et al.

EA-UMI-READ-0006

  • Claim: SIEVE 按可复用原语组合和转换接口分配选择预算,再优先保留各组合模式中稳定、中心的轨迹;论文报告其用 50% 示教和 50% 训练步数可优于全量训练。
  • Stance: limit | Confidence: direct
  • Paper: 2607.06442 SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
  • Locator: Introduction
  • Evidence: 引言的贡献列表同时说明了结构暴露、学习友好轨迹选择和半量数据超过全量训练的结果。
  • Quote: “Our contributions are as follows: • We propose a primitive-compositional view of trajectory utility, realized by Primitive Discovery and Structural Exposure Allocation, which allocate selection budgets according to reuse-aware primitive and transition exposure under diminishing returns. • We introduce Learning-Friendly Trajectory Selection, which selects medoid trajectories within each composition-pattern bucket to favor central, stable, and predictable realizations for behavior cloning. • We pr”
  • Authors: changti-wu; bin-yu; zhaolong-shen; et al.

References

Interactive Wiki

进入交互阅读

静态页采用默认版本;v0、v0、v0可在同一交互 Wiki 中阅读,不建立相互竞争的索引页。

Method and limits

研究方法、证据边界与引用说明

本页由当前结算的证据层自动派生,不改写已结算 run。论文只有在完整非 OCR 全文、结构化论文笔记和 claim-support audit 通过后,才进入接受证据。

页面结论是对所列论文与研究窗口的综合,不等同于无限外推。引用本专题时,请同时保留本页 canonical 地址、访问日期,并在需要时回溯原论文。