数据工程与质量 · Data Engineering and Quality

近一年已发表论文中的具身智能数据质量

Data Quality in Embodied AI

更新于

30 秒结论

先读这个判断

版本说明:本轮以 15 篇可获取完整正文的论文为论证主干,逐篇核对问题、方法、结果与限制;未能取得可读全文的论文不再承担正文结论。

精读论文
15
正式证据事件
15
知识单元
EA-DATA, EA-SENSOR, EA-MODEL, EA-EVAL
审计状态
当前结算 run 已通过仓库校验

v0 · 完整正文

研究综述

研究边界

版本说明:本轮以 15 篇可获取完整正文的论文为论证主干,逐篇核对问题、方法、结果与限制;未能取得可读全文的论文不再承担正文结论。

本备忘录覆盖 2025 年 7 月 14 日至 2026 年 7 月 14 日公开论文,主题限定在具身智能数据质量,重点落在机器人示教、VLA 微调、跨本体数据、遥操作采集、人类视频迁移和模仿学习数据筛选。本次范围综述从 851 条去重候选中核验 90 篇可用全文,并以 36 篇直接相关论文形成判断。它仍是公开论文的阶段性样本,不是仅限同行评审论文的完整普查。

中心判断

近一年论文的共同转向是:具身智能的数据质量不再等同于“清洗坏轨迹”或“采更多轨迹”,而是在目标任务、采集接口、数据分布、轨迹片段和训练过程之间建立闭环。换言之,高质量数据是 target-conditioned utility,而不是全局静态属性。QoQ 直接把质量定义为训练样本对验证示范和策略性能的贡献 Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning,IWR 把外部数据质量绑定到目标任务分布相关性 Data Retrieval with Importance Weights for Few-Shot Imitation Learning,ATHENA 则显示多任务 VLA 中还必须防止任务覆盖坍缩 ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation。

证据覆盖与限制

证据覆盖三类高信号问题:质量定义和度量(influence functions、PSD、trajectory entropy、importance weighting);采集端质量塑形(遥操作反馈、UMI gripper 设计、VR 输入模态);异构或弱质量数据如何进入训练(human video 仿真过滤、suboptimal data 选择性利用、OXE 跨本体扩增)。候选量、全文量、关键维度和连续低新增轮次均已满足停止条件。

核心机制

1. 质量首先是对目标策略有用。 QoQ 反对只用专家相似度、互信息或人工启发式做代理指标,主张用样本对验证示范 loss 降低和策略性能提升的影响来评估轨迹 Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning。IWR 给出相邻视角:当用外部大规模数据增强少样本任务时,数据是否“好”取决于目标分布与先验分布的概率比,而不是最近邻相似度本身 Data Retrieval with Importance Weights for Few-Shot Imitation Learning。两篇合起来说明,机器人数据质量需要以目标任务和目标策略为参照系,而不是以数据集内部几何为唯一参照。

因此,数据质量的核心不是“效用优先”或“多样性优先”二选一,而是目标效用、任务覆盖和坏轨迹风险之间的约束优化。

3. 质量从采集工具开始,而不是采完以后再补救。 DQAF 把遥操作 episode 的质量信号拆成任务进度、运动平滑性、停顿、关节极限,并把自然语言反馈闭环给采集员 Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration Collection。UMI gripper 研究显示,力分布、重量和人体工学会改变示教表现与操作者负担 Influence of Gripper Design on Human Demonstration Quality for Robot Learning。VR 研究进一步显示,输入设备和可视化会改变轨迹效率、不必要动作和执行精度,且不同任务偏好不同模态 From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday Tasks。三项研究共同把质量控制点前移到采集硬件、交互模态、采集员反馈和任务分解,而不只是离线筛选器。

4. 质量粒度正在从 episode 下探到 segment/chunk。 PSD metric 将低质量 end-user 示教具体化为过度纠正、振荡和突兀调整,提供无需 推演 或专家标签的快速排序 An Efficient Metric for Data Quality Measurement in Imitation Learning。WARP-RM 指出长程遥操作里的次优 episode 往往同时包含停顿、失误和高价值恢复片段,整条丢弃会浪费有用数据,因此需要 frame/chunk 级 progress signal WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation。

由此可见,episode 级质量分数适合采集员反馈和粗筛,训练阶段则需要更细粒度的片段价值估计。

5. 异构数据不是“能不能用”,而是“以什么条件进入训练”。 PSI 说明人类视频虽然能扩大数据来源,但必须通过仿真过滤排除位姿估计错误、机器人不可达和 grasp 不兼容轨迹 Imitating What Works: Simulation-Filtered Modular Policy Learning from Human Videos。OXE-AugE 把跨本体质量问题表述为 robot/gripper 分布不均衡,指出 OXE 中 top four robot types 占超过 85% 真实数据会带来过拟合风险 OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning。

五层质量栈

一个可操作的数据质量栈可以分成五层。第一层是 collection interface quality,检验采集硬件、VR 输入方式、遥操作 UI 和采集员反馈是否改变了轨迹质量 Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration Collection, Influence of Gripper Design on Human Demonstration Quality for Robot Learning, From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday Tasks。第二层是 trajectory health,检查平滑性、纠正动作、振荡、停顿和关节极限等可直接从轨迹或遥测中计算的信号 An Efficient Metric for Data Quality Measurement in Imitation Learning。

第三层是 target-conditioned utility,用 validation demonstrations、目标任务分布或 influence/retrieval 权重衡量数据对目标策略是否真正有用 Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning, Data Retrieval with Importance Weights for Few-Shot Imitation Learning。第四层是 coverage and balance,防止高分筛选导致任务、本体、夹爪或场景覆盖坍缩 ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation, OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning。

条件与分歧

现有结果主要来自特定机器人、任务集和训练配方,因此某种筛选信号在一个项目中有效,不代表它能跨本体、跨任务复用。开放空间抓放可能更看重轨迹平滑与几何覆盖,接触密集任务则更依赖力、触觉和恢复片段。这些差异不应被压缩成一个全局分数。

未解决问题

本轮证据尚未给出跨任务通用的质量基准,也缺少能把采集成本、人工复核、训练算力和真机收益放入同一账本的长期实验。另一个缺口是可追溯性:当策略退化时,现有管线很少能反推到具体数据版本、筛选规则和训练阶段。这是本轮检索的证据边界。

对后续研究的启发

后续实验应将“删除哪些数据”改写为“哪类数据在哪个训练阶段产生多大边际收益”。最小可行对照应同时报告数据量、覆盖变化、训练成本与真实闭环结果,并保留失败和恢复片段的独立统计。

工程落点

把上述证据转成工程动作,最重要的变化是取消单一质量分。采集端记录操作者负担、停顿、过度纠正和关节极限;训练前评估任务相关性、覆盖均衡与可执行性;训练后再用闭环成功率、恢复能力和分布外表现反校准筛选规则。这样才能区分“轨迹看起来整洁”与“轨迹确实改善目标策略”。

这套分层也给出了反例:某条轨迹可能动作不够平滑,却包含稀有失败恢复;某个数据子集与目标任务相似,却让少数任务完全失去覆盖;某种采集设备能提高速度,却增加接触损伤。质量治理的对象因此不是单条样本,而是样本进入特定训练阶段后产生的边际作用。

精读复核后的新证据

在移出两个无法取得完整正文的引用后,数据筛选的结论从“识别多样性”进一步收窄到“保留可复用结构与任务覆盖”。SIEVE 按原语组合和转换接口分配选择预算,再保留稳定、中心的轨迹;论文报告用一半示教和一半训练步数可优于全量训练。这与 ATHENA 对任务覆盖的要求相互补充:数据治理不能只做一个全局高分排名,还要防止小任务被整体淘汰。

同时,TACO 把数据质量推进到失败后的纠正片段:触觉感知世界模型联合预测视频与力,再为失败附近状态标注纠正动作。这说明“高质量数据”不只是干净的成功示教,还包括可定位、可恢复的失败边界。

对工程管线而言,这意味着筛选器要同时输出样本效用、任务覆盖和失败可恢复性,而不是只给一个不可解释的总分。只有这三类信号一起进入版本比较,数据质量才能被持续治理。

References

Accepted evidence

去重论文引用

  1. An Efficient Metric for Data Quality Measurement in Imitation LearningNoushad Sojib, Momotaz Begum · 2026
  2. ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data CurationTao Xu, Jiaxin Wang, Runhao Zhang, Jiayi Guan, Xianchao Zeng, Weixi Song, Xinyu Zhou, Zhetao Chen et al. · 2026
  3. Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration CollectionGokul Narayanan, Yash Shahapurkar, Melih Erdogan, Brian Zhu, Eugen Solowjow · 2026
  4. Data Retrieval with Importance Weights for Few-Shot Imitation LearningAmber Xie, Rahul Chand, Dorsa Sadigh, Joey Hejna · 2025
  5. From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday TasksRobin Beierling, Manuel Scheibl, Jonas Dech, Abhijit Vyas, Anna-Lisa Vollmer · 2026
  6. Imitating What Works: Simulation-Filtered Modular Policy Learning from Human VideosAlbert J. Zhai, Kuo-Hao Zeng, Jiasen Lu, Ali Farhadi, Shenlong Wang, Wei-Chiu Ma · 2026
  7. Influence of Gripper Design on Human Demonstration Quality for Robot LearningGina L. Georgadarellis, Natalija Beslic, Seonhun Lee, Frank C. Sup, Meghan E. Huber · 2026
  8. OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy LearningGuanhua Ji, Harsha Polavaram, Lawrence Yunliang Chen, Sandeep Bajamahal, Zehan Ma, Simeon Adebola, Chenfeng Xu, Ken Goldberg · 2025
  9. Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot LearningHaeone Lee, Taywon Min, Junsu Kim, Sinjae Kang, Fangchen Liu, Lerrel Pinto, Kimin Lee · 2026
  10. RoboDream: Compositional World Models for Scalable Robot Data SynthesisJunjie Ye, Rong Xue, Basile Van Hoorick, Runhao Li, Harshitha Rajaprakash, Pavel Tokmakov, Muhammad Zubair Irshad, Vitor Guizilini et al. · 2026
  11. SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA ModelsChangti Wu, Bin Yu, Zhaolong Shen, Shijie Lian, Xiaopeng Lin, Cong Huang, Zhirui Zhang, Lei Zhang et al. · 2026
  12. TACO: TActile World Model as a Self-COrrector forScalable VLA Post-TrainingShengbang Liu, Yueru Jia, Yuyang Yan, Jiaming Liu, Xinran Zhang, Qiuxuan Feng, Yandong Guo, Shiji Zhou et al. · 2026
  13. WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data CurationJustin Yu, Andrew Goldberg, Kavish Kondap, Karim El-Refai, Ethan Ransing, Qianzhong Chen, Mac Schwager, Fred Shentu et al. · 2026
  14. World Model Self-Distillation: Training World Models to Solve General TasksSebastian Stapf · 2026
  15. World Pilot: Steering Vision-Language-Action Models with World-Action PriorsWorld Pilot authors · 2026
完整证据附录(15 条正式证据事件)
  • Time range: 2025-07-14..2026-07-14
  • Events: 15
  • 每个事件一节,标题即锚点;trace-map 中的 event 链接跳转到这里。

EA-DQ-YEAR-READ-0008

  • Claim: 少样本部署场景下,外部大规模数据的“质量”主要取决于对目标任务分布的相关性;只按最近邻相似度检索会受噪声和先验数据分布偏差影响。
  • Stance: support | Confidence: direct
  • Paper: 2509.01657 Data Retrieval with Importance Weights for Few-Shot Imitation Learning
  • Locator: Abstract (full-text section)
  • Evidence: IWR 将 retrieval-based imitation learning 的常用最近邻规则解释为目标数据分布 KDE 的极限,指出其高方差、易受噪声影响且不考虑 prior data distribution;方法用目标/先验分布概率比进行 importance-weighted retrieval,并在仿真和 Bridge 真实评估中改善现有检索方法。
  • Quote: “Abstract While large-scale robot datasets have propelled recent progress in imitation learning, learning from smaller task specific datasets remains critical for deployment in new environments and unseen tasks. One such approach to few-shot imitation learning is retrieval-based imitation learning, which extracts relevant samples from large, widely available prior datasets to augment a limited demonstration dataset. To determine the relevant data from prior datasets, retrieval-based approaches mo”
  • Authors: amber-xie; rahul-chand; dorsa-sadigh; et al.

EA-DQ-YEAR-READ-0009

  • Claim: 跨本体机器人数据的质量问题不只是轨迹数量,而是本体/夹爪分布是否均衡;高度不平衡的数据集会让策略过拟合少数 robot-scene 组合。
  • Stance: support | Confidence: direct
  • Paper: 2512.13100 OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning
  • Locator: Abstract (full-text section)
  • Evidence: 论文指出 OXE 聚合 60 多个机器人数据集,但 top four robot types 占超过 85% 真实数据,带来过拟合风险;OXE-AugE 用 9 种不同机器人本体扩增 16 个 OXE 子集,形成 4.4M trajectories,并研究扩增对 cross-embodiment learning 的影响。
  • Quote: “Abstract Large and diverse datasets are needed for training generalist robot policies that have potential to control a variety of robot embodiments—robot arm and gripper combinations—across diverse tasks and environments. As re-collecting demonstrations and retraining for each new hardware platform are prohibitively costly, we show that existing robot data can be augmented for transfer and generalization. The Open X-Embodiment (OXE) dataset, which aggregates demonstrations from over 60 robot dat”
  • Authors: guanhua-ji; harsha-polavaram; lawrence-yunliang-chen; et al.

EA-DQ-YEAR-READ-0005

  • Claim: 示教数据质量不应只用相似度、互信息或人工启发式代理指标定义;QoQ 将高质量轨迹定义为对目标验证示范 loss 降低和策略性能提升有直接贡献的数据。
  • Stance: support | Confidence: direct
  • Paper: 2603.09056 Quality over Quantity: Demonstration Curation via Influence Functions for Data-Centric Robot Learning
  • Locator: VI CONCLUSIONS
  • Evidence: 论文指出人类遥操作会带来错误、操作约束、技能差异、噪声和次优行为;QoQ 用 influence functions 衡量训练 state-action 对验证示范的贡献,并在轨迹层聚合以降低噪声、保持覆盖,在仿真、真实机器人和 DROID in-the-wild 数据上改善策略成功率。
  • Quote: “In this work, we propose QoQ, a method that curates robotic datasets based on direct performance contribution to the learned policy. We define a quality scoring mechanism for state-action pairs derived from influence functions.”
  • Authors: haeone-lee; taywon-min; junsu-kim; et al.

EA-DQ-YEAR-READ-0001

  • Claim: 示教数据质量会被采集硬件本身塑形;UMI 类手持 gripper 的力分布、重量和人体工学会影响任务表现、操作者负担和后续可学习策略。
  • Stance: support | Confidence: direct
  • Paper: 2603.17189 Influence of Gripper Design on Human Demonstration Quality for Robot Learning
  • Locator: V DISCUSSION
  • Evidence: 论文指出 UMI 示教虽快于遥操作但仍比手工慢、工具重量会造成疲劳并影响 demonstration;实验中改变 UMI gripper fingers 的力分布显著影响打开绷带包装表现,concentrated load grippers 优于 distributed load grippers,作者将其连接到 demonstration quality 和 learned robot control policies。
  • Quote: “Overall, the usability study demonstrated that altering the force distribution of UMI gripper fingers significantly affected participants’ ability to open bandage packages, with concentrated load grippers outperforming distributed load grippers. These findings highlight that subtle hardware changes can substantially improve demonstration quality and, in turn, the robot control policies learned from them.”
  • Authors: gina-l-georgadarellis; natalija-beslic; seonhun-lee; et al.

EA-DQ-YEAR-READ-0006

  • Claim: 面向部署环境的 end-user 示教,低质量常表现为过度纠正、振荡和突兀调整;轨迹功率谱密度 PSD 可作为无需 rollout、专家标签或重新训练的快速质量排序指标。
  • Stance: support | Confidence: direct
  • Paper: 2605.01544 An Efficient Metric for Data Quality Measurement in Imitation Learning
  • Locator: Abstract (full-text section)
  • Evidence: 论文把 poor-quality end-user demonstrations 具体化为 excessive corrective motions、oscillations 和 abrupt adjustments,并提出基于 demonstration trajectories PSD 的自动排序指标;实验比较未筛选、oracle、现有排序和 jerk/path-length 等 baseline,研究 PSD 筛选对下游 IL 成功率和平滑性的影响。
  • Quote: “Abstract Imitation learning (IL) has seen remarkable progress, yet field deployment of IL-powered robots remains hindered by the challenge of out-of-distribution (OOD) scenarios. Fine-tuning pre-trained policies with end-user demonstrations collected in deployment environments is a promising strategy to address this challenge. However, end-user demonstrations are frequently of poor quality, characterized by excessive corrective motions, oscillations, and abrupt adjustments that degrade both lear”
  • Authors: noushad-sojib; momotaz-begum

EA-DQ-YEAR-READ-0007

  • Claim: DQAF 不用成功/失败二值标签代替数据质量,而是联合子任务进度、动作平滑度、停顿和运动学极限生成 episode 级评估与给操作者的纠正反馈。
  • Stance: support | Confidence: direct
  • Paper: 2605.26349 Closing the Loop in Teleoperation: Episode-Level Data Quality Assessment and Feedback for High-Quality Demonstration Collection
  • Locator: Abstract (full-text section)
  • Evidence: 摘要明确列出了质量信号、结构化评估和可执行的自然语言反馈。
  • Quote: “Abstract Industrial automation is at a pivotal moment, as Physical AI is driving a transition from rigid, hand-engineered automation systems toward more flexible and adaptive systems. This shift has created a growing demand for large-scale, real-world robot demonstration data, making teleoperation an increasingly important mechanism for data collection. However, high-quality teleoperated demonstrations remain difficult to obtain in practice, as novice operators often produce episodes that are ta”
  • Authors: gokul-narayanan; yash-shahapurkar; melih-erdogan; et al.

EA-DQ-YEAR-READ-0010

  • Claim: 在多任务 VLA 微调中,数据质量治理要同时考虑样本效用和任务覆盖;单一全局排序会让某些任务被几乎淘汰,导致任务级覆盖坍缩。
  • Stance: support | Confidence: direct
  • Paper: 2606.16208 ATHENA: Accelerated Multi-Task Heterogeneous Influence Functions for Robot Data Curation
  • Locator: C.4 Retention Balance, Single-Task Curation, and Real-Robot Failure Modes
  • Evidence: ATHENA 指出 VLA 性能不只取决于规模,也取决于 demonstration quality,大规模冗余数据甚至可能伤害性能;在六任务真实机器人设置中,naive global influence ranking 让 Stack Bowls 只保留 13 条示教,而 MII 结合 task-local 和 cross-task influence utilities 后保留分布更均衡。
  • Quote: “To further ablate the role of Multitask Influence Interaction (MII), we visualize the retained task distributions after data curation in Fig. 8 . We consider the six-task real-robot setting with 120 demonstrations per task and an overall retention ratio of 66.7%. Without MII, naively ranking demonstrations with a single global influence score results in a highly skewed retained set: Pick Fruits, Shelf Retrieval, and Wipe Board retain 115, 113, and 104 demonstrations, respectively, whereas Stack”
  • Authors: tao-xu; jiaxin-wang; runhao-zhang; et al.

EA-DQ-YEAR-READ-0002

  • Claim: VR 示教质量依赖交互模态和视觉表示,并且不同任务会偏好不同输入配置;采集系统优化不能只追求沉浸感或视觉保真。
  • Stance: conditional | Confidence: direct
  • Paper: 2602.10618 From Interaction to Demonstration Quality in Virtual Reality: Effects of Interaction Modality and Visual Representation on Everyday Tasks
  • Locator: 1 Introduction
  • Evidence: 论文指出 VR 用于记录机器人学习示教时,visual fidelity 可能不如 user behavior 的 quality/reliability 重要;输入设备与可视化会影响工作负荷、运动效率、不必要动作和执行精度。实验发现 controller 与 motion-capture gloves 在 pick-and-place 与 manner-oriented tasks 上呈现不同轨迹策略和权衡。
  • Quote: “In contrast, when VR is used to record demonstrations for robot learning, visual fidelity may be less important than the quality and reliability of user behavior during task execution.”
  • Authors: robin-beierling; manuel-scheibl; jonas-dech; et al.

EA-DQ-YEAR-READ-0003

  • Claim: 人类视频能扩大机器人学习数据来源,但其质量取决于机器人可执行性和任务兼容性;仿真过滤可把不可达、估计错误或 grasp 不兼容的轨迹排除或标注出来。
  • Stance: conditional | Confidence: direct
  • Paper: 2602.13197 Imitating What Works: Simulation-Filtered Modular Policy Learning from Human Videos
  • Locator: 3.3 Trajectory and Grasp Filtering via Simulation
  • Evidence: PSI 将人类演示转换为 6DoF object pose trajectories 后在仿真中执行,用于过滤不适合机器人学习的数据;不适合原因包括 pose estimation errors 和机器人 physically unachievable trajectories,并生成 grasp suitability labels 以学习 task-oriented grasping。
  • Quote: “Now that we have converted the human demonstrations into 6 DoF object pose trajectories, the next step is to execute them on a robot in simulation. This serves two purposes. One is to filter out those that may not be suitable for robot learning. There are two main reasons a trajectory may be unsuitable. First, pose estimation errors can lead to inaccurate trajectories. Second, the extracted trajectory may not be physically achievable by the robot. In either case, it would be harmful to train the”
  • Authors: albert-j-zhai; kuo-hao-zeng; jiasen-lu; et al.

EA-DQ-YEAR-READ-0011

  • Claim: Synthetic world-model data for robot learning needs embodiment anchoring: rendered robot motion plus explicit scene and object priors can synthesize demonstrations in novel objects, scenes, and viewpoints while reducing teleoperation burden.
  • Stance: conditional | Confidence: direct
  • Paper: 2606.02577 RoboDream: Compositional World Models for Scalable Robot Data Synthesis
  • Locator: Abstract (full-text section)
  • Evidence: RoboDream anchors generation to rendered robot motion, conditions on scene/object priors, and introduces retrieval-and-rebirth plus prop-free teleoperation to generate demonstrations and reduce real data collection cost.
  • Quote: “Abstract Scaling robot learning requires large-scale, diverse demonstrations, yet real-world data collection via teleoperation remains prohibitively expensive and time-consuming. While video diffusion models offer a promising avenue for data scaling, existing generative approaches are often limited to superficial visual augmentation, or suffer from embodiment hallucinations that yield physically infeasible motions. We present a generalizable embodiment-centric world model that achieves scalable”
  • Authors: junjie-ye; rong-xue; basile-van-hoorick; et al.

EA-DQ-YEAR-READ-0012

  • Claim: Paired task-execution videos are useful but costly; self-distillation can partially replace curated task-video supervision by using unlabeled scene images, VLM-generated tasks and solutions, and VLM feedback as weak verification.
  • Stance: conditional | Confidence: direct
  • Paper: 2606.12072 World Model Self-Distillation: Training World Models to Solve General Tasks
  • Locator: Abstract (full-text section)
  • Evidence: WMSD frames supervised fine-tuning on paired task-execution videos as costly, then proposes self-distillation and reinforcement learning where a VLM generates tasks/solutions from unlabeled scene images and feedback verifies sampled videos.
  • Quote: “Abstract Pretrained video generators are promising visual world models that exhibit emergent task-solving abilities; however, their reliance on detailed textual descriptions limits their direct use for planning and decision-making. Existing approaches either outsource this reasoning to language or vision-language models, or rely on supervised fine-tuning with paired task-execution videos, which are costly to collect and difficult to scale. We propose a scalable framework that elicits task-solvin”
  • Authors: sebastian-stapf

EA-DQ-YEAR-READ-0004

  • Claim: 混合质量的长程示教不应粗粒度整条丢弃;次优 episode 里可能含有高价值恢复片段,质量控制需要下探到 frame/chunk 级别的进展信号。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.28320 WARP-RM: A Warp-Augmented Relative Progress Reward Model for Data Curation
  • Locator: Abstract (full-text section)
  • Evidence: 论文指出长程遥操作包含 pauses、fumbles 和 recoveries,整条 episode 过滤会丢失 otherwise suboptimal executions 中嵌入的 high-advantage segments,也无法剪掉保留示教中的局部 hesitation;WARP-RM 学习 dense relative progress 并用 WARP-BC upweight high-advantage action chunks。
  • Quote: “Abstract Scaling imitation learning requires large datasets, yet human teleoperation inevitably produces mixed-quality demonstrations containing hesitations and recoveries. Prior frame-level progress reward models supervise on absolute temporal progress proxies that suffer from label noise, or require costly human annotations to define subtask boundaries. We present WARP (Warp-Augmented Relative Progress), a novel fully self-supervised algorithm for learning dense, signed relative progress magni”
  • Authors: justin-yu; andrew-goldberg; kavish-kondap; et al.

EA-DQ-YEAR-READ-0013

  • Claim: Static image-text pretraining is insufficient training signal for contact-rich manipulation; world-model data should expose action-conditioned scene evolution and contact dynamics.
  • Stance: limit | Confidence: direct
  • Paper: 2606.12403 World Pilot: Steering Vision-Language-Action Models with World-Action Priors
  • Locator: Abstract (full-text section)
  • Evidence: World Pilot argues that VLA semantic grounding from static image-text pairs cannot capture continuous contact-rich dynamics, and uses WAM-derived scene-evolution and trajectory priors to complement the policy.
  • Quote: “Abstract Vision-Language-Action (VLA) models inherit semantic grounding from large-scale pretraining and perform competently across in-distribution manipulation tasks. This grounding, however, is built on static image-text pairs, whereas manipulation is a continuous, contact-rich process whose dynamics this pretraining cannot capture. We present World Pilot, a VLA framework that augments the policy with priors from a World-Action Model (WAM), routed into the decision chain through two complement”
  • Authors: world-pilot-authors

EA-DQ-YEAR-READ-0014

  • Claim: TACO 用触觉感知世界模型联合预测未来视频和力序列,再将真实失败附近状态转成带纠正动作的想象片段,用于接触丰富任务的 VLA 后训练。
  • Stance: limit | Confidence: direct
  • Paper: 2607.02840 TACO: TActile World Model as a Self-COrrector forScalable VLA Post-Training
  • Locator: 5 Conclusion and Limitations
  • Evidence: 结论的 Recognize–Imagine–Label 回路明确连接了真实失败、视频—力联合想象与纠正动作标注。
  • Quote: “We presented TACO, a tactile-aware world-model-driven framework for scalable VLA post-training in contact-rich manipulation. Following a Recognize–Imagine–Label loop, TACO converts real-world failures into imagined corrections without repeated human intervention: a tactile-aware world model jointly denoises future video and force sequences, while a unified progress-action model recognizes failure-adjacent states and labels imagined segments with corrective actions. To incorporate this supervisio”
  • Authors: shengbang-liu; yueru-jia; yuyang-yan; et al.

EA-DQ-YEAR-READ-0015

  • Claim: SIEVE 按可复用原语组合和转换接口分配选择预算,再优先保留各组合模式中稳定、中心的轨迹;论文报告其用 50% 示教和 50% 训练步数可优于全量训练。
  • Stance: limit | Confidence: direct
  • Paper: 2607.06442 SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
  • Locator: Introduction
  • Evidence: 引言的贡献列表同时说明了结构暴露、学习友好轨迹选择和半量数据超过全量训练的结果。
  • Quote: “Our contributions are as follows: • We propose a primitive-compositional view of trajectory utility, realized by Primitive Discovery and Structural Exposure Allocation, which allocate selection budgets according to reuse-aware primitive and transition exposure under diminishing returns. • We introduce Learning-Friendly Trajectory Selection, which selects medoid trajectories within each composition-pattern bucket to favor central, stable, and predictable realizations for behavior cloning. • We pr”
  • Authors: changti-wu; bin-yu; zhaolong-shen; et al.

References

Interactive Wiki

进入交互阅读

静态页采用默认版本;v0、v0、v0可在同一交互 Wiki 中阅读,不建立相互竞争的索引页。

Method and limits

研究方法、证据边界与引用说明

本页由当前结算的证据层自动派生,不改写已结算 run。论文只有在完整非 OCR 全文、结构化论文笔记和 claim-support audit 通过后,才进入接受证据。

页面结论是对所列论文与研究窗口的综合,不等同于无限外推。引用本专题时,请同时保留本页 canonical 地址、访问日期,并在需要时回溯原论文。