Embodied AI Evidence Hub具身智能证据知识库

多模态感知 · Multimodal Perception

具身传感器感知误差

Sensor Perception Errors in Embodied AI

更新于

30 秒结论

先读这个判断

版本说明：本轮以 15 篇可获取完整正文的论文为论证主干，逐篇核对问题、方法、结果与限制；未能取得可读全文的论文不再承担正文结论。

精读论文
15
正式证据事件
15
知识单元
EA-SENSOR, EA-DATA, EA-EVAL
审计状态
当前结算 run 已通过仓库校验

v0 · 完整正文

研究综述

版本说明：本轮以 15 篇可获取完整正文的论文为论证主干，逐篇核对问题、方法、结果与限制；未能取得可读全文的论文不再承担正文结论。

研究边界与证据范围

本备忘录覆盖 2026 年 1 月 14 日至 7 月 14 日公开论文，范围从触觉、力觉和事件视觉扩展到标定、融合、不确定性和闭环评测。本次范围综述从 903 条去重候选中核验 130 篇可用全文，并以 32 篇直接相关论文构成论证主干。论文数量、关键维度和连续低新增轮次均满足停止条件，但结论仍代表当前半年窗口，不等价于长期共识。TouchWorld 与世界模型可接纳性研究分别代表接触可观测性和评测边界。Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators

中心判断是：具身传感器感知误差正在从“图像识别误差”扩展为“任务条件下的可观测性、时延、融合和评测误差”。视觉仍是语义和几何主干，但近半年的论文反复指出，接触状态、滑移、力不匹配、局部对齐误差、照明退化和分布外不确定性不能靠 RGB 单独兜住（TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation, You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact, Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model）。

四类误差机制

第一类误差是“接触后才出现的物理状态不可观测”。TouchWorld 将滑移、错位、不稳定抓取和力不匹配视为灵巧操作的局部误差，并把触觉用于高频残差修正；MuSe 也把力、触觉和音频视为图像外的交互状态来源。两项工作共同说明：触觉不是视觉替代物，而是接触闭环里的局部状态传感器。TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation, Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to Force

第二类误差是“视觉几何在边界条件下崩掉”。YOTO 直接把遮挡、弱光、反光和透明表面列为视觉位姿估计的失败条件，并用单次双触点触觉恢复 6-DoF pose；RGB-S 则把触觉传感器位置投影到图像域，用 force-modulated saliency 显式建模运动学和标定误差带来的空间不确定性（You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact, RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation）。

第三类误差是“策略模型知道自己不知道的能力不足”。两篇 VLA 不确定性论文都把失败检测放在分布偏移场景：一篇用 hidden activation perturbation 估计 epistemic signal，另一篇用 velocity-field disagreement 量化 flow-based VLA 的不可靠性。这说明传感器误差和模型误差在闭环中会耦合：同一个观测退化，既是输入质量问题，也是 action confidence 问题（Perturbation-Based Uncertainty for Failure Detection in Vision-Language-Action Models, Uncertainty Quantification for Flow-Based Vision-Language-Action Models）。

第四类误差是“多模态融合本身引入新失真”。Tactile-WAM 的关键限制是，接触任务里 RGB 未来可能视觉上合理但物理上不完整；但把触觉 token 无约束注入视觉 dynamics model 又会产生 tactile pollution。因此多传感器路线的研究问题不是“加不加触觉”，而是“触觉何时进入、进入哪个 action horizon、是否污染原视觉先验”（Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention）。

第五类误差是“监控与评测错位”。PATCH 认为全局视觉异常、帧级变化和策略不确定性不够，要看异常是否落在当前动作片段的执行走廊；SoftVTBench 则显示只看 Goal Success 会高估策略，需要 Safety Success、无掉落和形变约束；世界模型评测论文进一步提醒，视觉逼真度不能证明仿真器会按动作正确响应。PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation, SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects, Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators.

对后续研究的启发

传感器误差可以拆成四层来研究：观测层看遮挡、照明、深度/位姿/标定噪声；接触层看滑移、力、形变和接触稳定性；融合层看模态同步、token 注入、标定投影和 missing modality；评测层看闭环成功、安全过程、恢复能力和 world-model admissibility。这是一个推论框架，来自上述事件的组合，而不是单篇论文直接给出的分类。 RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation, Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention, Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators.

对项目实践而言，优先做“任务族误差预算”而不是泛泛采购传感器：透明/反光/遮挡物体优先补触觉或多视角；接触丰富任务优先补力/触觉和高频残差控制；照明变化优先考虑事件流或视觉鲁棒性；柔性物必须把形变和安全过程纳入验收。Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model, SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects.

条件、限制与未解决问题

当前证据仍有三个缺口：第一，多数结果是基准、仿真或作者报告的真实任务，缺少跨实验室复现；第二，传感器漂移、磨损、跨硬件实例泛化在本次窗口内没有形成统一字段标准；第三，世界模型能否作为具身策略评测裁判仍需要 admissibility 证据，而不是只看视频质量（Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators）。

中心判断

具身感知误差不是一个统一的“视觉识别错误”，而是观测缺失、跨传感器标定、时序同步、状态估计与不确定性管理共同造成的状态偏差。尤其在最后一厘米的接触阶段，视觉仍可能正确识别物体，却无法观测滑移、力分布和接触稳定性。更强的图像骨干只能改善其中一部分，不能替代物理状态的补测与闭环校验。

工程上应把误差验收从最终成功率前移：先记录每种传感器能看见什么，再检查坐标系、时间戳和动作语义是否一致，最后观察模型在信号冲突时能否降低置信度或请求补充观测。只有这样，失败才能归因到“没观测到”“观测错位”或“看见但没有正确使用”，而不是全部记作模型失败。

对于柔性物、透明物和接触密集任务，建议把触觉、力矩或主动探测设计成条件触发的补充通道，而非无条件堆叠所有模态。多传感器系统同样会因标定漂移、延迟和错误融合产生新误差；新增模态必须用失败检测收益证明其价值。

研究设计上还应加入受控退化实验。分别遮挡相机、扰动标定、延迟触觉、删除力信号，再观察错误首先出现在哪一层。若去掉某模态后只有离线表征变化、真实动作结果不变，说明它尚未提供独立状态；若轻微同步偏差就使成功率骤降，则系统瓶颈在融合与时钟，而不是感知骨干。

评测需要把“任务完成”拆成过程安全和结果正确。柔性物到达目标位置但已经过度变形，抓取完成但发生滑移，或世界模型画面对却没有遵循动作，都不应计为可靠成功。过程指标能暴露被最终成功率掩盖的感知误差，也能为传感器投资提供更直接依据。

长期部署还要记录传感器磨损与漂移。实验室里的单次标定不能代表数周运行；触觉表面老化、相机位姿微变和力矩零点漂移都会改变输入分布。持续校验、漂移告警和跨硬件实例复测，应成为感知系统的一部分，而不是维护阶段的附加工作。

References

Accepted evidence

去重论文引用

  1. Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action ModelJiaxin Liu, Xun Xu, Zhenhao Zhang, Hanqing Wang, Ruiqi Chen, Shi Chang, Weiyu Guo, Laurent Kneip · 2026
  2. HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation LearningAmirhosein Alian, Yongqiang Zhao, Shiyi Gu, Xuyang Zhang, Zhuo Chen, Christopher E. Mower, Haitham Bou-Ammar, Shan Luo · 2026
  3. Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to ForceJaden Clark, Changhao Wang, Yihuai Gao, Seongheon Hong, Hojung Choi, Mark Cutkosky, Yifan Hou, Shuran Song · 2026
  4. PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot ManipulationYanan Zhou, Ranpeng Qiu, Yincong Chen, Jiajie Cui, Weiming Zhi · 2026
  5. Perturbation-Based Uncertainty for Failure Detection in Vision-Language-Action ModelsYousung Lee, Dongsoo Har · 2026
  6. Revisiting Embodied Chain-of-Thought for Generalizable Robot ManipulationNan Sun, Yuan Zhang, Yongkun Yang, Wentao Zhao, Peiyan Li, Jun Guo, Wenxuan Song, Pengxiang Ding et al. · 2026
  7. RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous ManipulationShengcheng Luo · 2026
  8. SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable ObjectsBowen Jing, Mingxin Wang, Ruiyang Hao, Chenchen Ge, Hanwen Shen, Junjie He, Yang Cui, Yiming Hou et al. · 2026
  9. TacForeSight: Force-Guided Tactile World Model for Contact-Rich ManipulationYujie Zang, Yuhang Zheng, Xian Nie, Yupeng Zheng, Shuai Tian, Songen Gu, Chen Gao, Zining Wang et al. · 2026
  10. TACO: TActile World Model as a Self-COrrector forScalable VLA Post-TrainingShengbang Liu, Yueru Jia, Yuyang Yan, Jiaming Liu, Xinran Zhang, Qiuxuan Feng, Yandong Guo, Shiji Zhou et al. · 2026
  11. Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric AttentionSiyu Wu · 2026
  12. TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous ManipulationJianyi Zhou, Feiyang Hong, Yunhao Li, Yicheng Zhao, Yongjue Cen, Zirui Liu, Jiakang Huang, Zirui Chen et al. · 2026
  13. Uncertainty Quantification for Flow-Based Vision-Language-Action ModelsRalf Römer, Maximilian Seeliger, Saida Liu, Ben Sturgis, Marco Bagatella, Daniel Marta, Andreas Krause, Angela P. Schoellig · 2026
  14. Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model SimulatorsChristian Oefinger, Finn Rasmus Schäfer, Korbinian Moller, Mattia Piccinini, Johannes Betz · 2026
  15. You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile ContactPengfei Ye, Yuxiang Ma, Haonan Chen, Guangming Wang, Yixiong Jing, Brian Sheil, Yilun Du, Edward Adelson · 2026
完整证据附录（15 条正式证据事件）
  • Time range: 2026-01-14..2026-07-14
  • Events: 15
  • 每个事件一节,标题即锚点;trace-map 中的 event 链接跳转到这里。

EA-SENSORERR-READ-0008

  • Claim: Flow-based VLA 在真实部署时缺少置信度机制会形成安全与恢复缺口；velocity-field disagreement 可把动作预测的不可靠性转成失败检测和主动微调信号。
  • Stance: support | Confidence: direct
  • Paper: 2606.18043 Uncertainty Quantification for Flow-Based Vision-Language-Action Models
  • Locator: Abstract (full-text section)
  • Evidence: 作者将真实非平稳环境中的分布外场景描述为 VLA 可能“无预警失败”的关键限制，并提出用小 ensemble 的 velocity-field disagreement 量化 epistemic uncertainty；LIBERO 实验显示该不确定性与下游表现、失败检测和主动采样相关。
  • Quote: “This presents a critical limitation for real-world deployment in non-stationary environments, where models inevitably encounter scenarios outside their pretraining distribution and may fail without warning. To address this, we derive an efficient method for quantifying epistemic uncertainty in flow-matching models by leveraging velocity-field disagreement (VFD) across a small ensemble.”
  • Authors: ralf-rmer; maximilian-seeliger; saida-liu; et al.

EA-SENSORERR-READ-0009

  • Claim: VLA 的感知-动作误差不只来自传感器本身，也来自分布外观测下模型无法给出可靠置信度；隐藏激活扰动产生的 epistemic signal 可用于失败检测。
  • Stance: support | Confidence: direct
  • Paper: 2606.20754 Perturbation-Based Uncertainty for Failure Detection in Vision-Language-Action Models
  • Locator: Abstract (full-text section)
  • Evidence: 作者指出现代 VLA 常用回归或 flow-based action generation，缺少显式预测概率；他们通过对 transformer hidden activations 注入高斯扰动，利用扰动后动作预测分歧估计不确定性，并在 LIBERO/LIBERO-PRO 的分布偏移下提升失败检测。
  • Quote: “Specifically, we inject Gaussian perturbations into transformer hidden activations and estimate epistemic signals from disagreement across perturbed action predictions. Experiments on LIBERO and LIBERO-PRO show that perturbation-based uncertainty consistently improves failure detection under distribution shift compared to sampling-based uncertainty, providing a practical uncertainty signal for VLA models.”
  • Authors: yousung-lee; dongsoo-har

EA-SENSORERR-READ-0010

  • Claim: 物体 6-DoF 位姿误差在遮挡、弱光、反光/透明表面下会让视觉方法失效；单次双触点触觉可作为视觉不可靠时的位姿观测补充。
  • Stance: support | Confidence: direct
  • Paper: 2606.28899 You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact
  • Locator: Abstract (full-text section)
  • Evidence: 作者明确指出视觉位姿估计常在遮挡、差光照、反光或透明表面下失败，并提出 tactile-only pose estimation：把触觉接触表示成局部 3D 点云，结合校准传感器位姿恢复完整 6-DoF object pose；实验在视觉不可靠时优于视觉和几何基线。
  • Quote: “Abstract Accurate 6-DoF object pose estimation is fundamental to robotic manipulation, yet vision-based methods often fail under occlusion, poor lighting, and reflective or transparent surfaces.”
  • Authors: pengfei-ye; yuxiang-ma; haonan-chen; et al.

EA-SENSORERR-READ-0011

  • Claim: RGB-centric VLA 在照明变化导致的可见性退化下会暴露鲁棒性问题；事件流作为对照明更鲁棒、对运动敏感的补充观测，可以改善不同可见性水平下的动作预测。
  • Stance: support | Confidence: direct
  • Paper: 2606.29384 Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model
  • Locator: Abstract (full-text section)
  • Evidence: 作者指出现有 VLA 往往假设稳定明亮的室内环境，而真实操作中 illumination shifts 会造成 degraded RGB observations；Event-VLA 将 degraded visibility 定义为 RGB-centric policies 的鲁棒性问题，并通过 action-query routing 将 event streams 融入 action representation，仿真和真实部署实验显示在不同可见性下保持更强鲁棒性。
  • Quote: “Abstract Vision-Language-Action (VLA) models have become an important paradigm of embodied AI. However, existing VLA models typically assume well-lit and stable indoor settings, while real-world embodied manipulation may involve degraded RGB observations caused by illumination shifts, posing critical challenges for robust robotic manipulation. To address this gap, we propose Event-VLA , an event-enhanced VLA framework for generalizable manipulation across varying illumination conditions. We form”
  • Authors: jiaxin-liu; xun-xu; zhenhao-zhang; et al.

EA-SENSORERR-READ-0012

  • Claim: 触觉在灵巧操作中补足视觉/语言无法稳定观测的接触隐变量；滑移、力不匹配、接触稳定性等局部误差需要比语义规划更快的反馈通道。
  • Stance: support | Confidence: direct
  • Paper: 2607.07287 TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
  • Locator: Abstract (full-text section)
  • Evidence: 作者把日常灵巧操作的误差来源明确落在滑移、错位、不稳定抓取和力不匹配上，并指出视觉/语言不能可靠揭示力、滑移和接触稳定性；其分层策略将视觉语言子任务规划、触觉世界模型预测和高频触觉残差修正分开。
  • Quote: “Vision and language provide semantic and geometric guidance, but they cannot reliably reveal hidden contact states such as force, slip, and contact stability.”
  • Authors: jianyi-zhou; feiyang-hong; yunhao-li; et al.

EA-SENSORERR-READ-0013

  • Claim: ERVLA 的大规模实验表明，有效的具身 CoT 需要落到末端执行器运动或图像空间轨迹等动作相关表示，而将显式 CoT 作为自回归动作前缀会在推理时累积误差。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.03784 Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
  • Locator: Abstract (full-text section)
  • Evidence: 摘要同时给出了动作相关 grounding 的有效性与 autoregressive action prefix 的 compounding-error 限制。
  • Quote: “Abstract Embodied chain-of-thought (CoT) aims to bridge linguistic reasoning with robotic control, yet its effective form and integration remain underexplored. In this paper, we revisit embodied CoT for robotic control at an unprecedented scale. We curate the largest embodied CoT corpus to date, comprising 978,743 trajectories, 226.3M samples, and 2592.5 hours of data. Through extensive experiments, we show that effective CoT must ground high-level semantic understaning in concrete linguistic ac”
  • Authors: nan-sun; yuan-zhang; yongkun-yang; et al.

EA-SENSORERR-READ-0014

  • Claim: HapTile 的数据质量控制在机器人控制环中同步全部模态，检查空轨迹、损坏轨迹和时间戳缺口，并验证动作—状态一致性。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.04825 HapTile: A Haptic-Informed Vision-Tactile-Language-Action Dataset for Contact-Rich Imitation Learning
  • Locator: 3.2 Synchronization and Data Quality Control
  • Evidence: 数据质量段明确记录了控制环同步、时间戳缺口检查、损坏轨迹剔除和 action-state consistency 检查。
  • Quote: “All data modalities are synchronized through the robot control loop. For policy learning, actions are converted to a unified 7D end-effector delta representation (1) where are translational deltas, are rotational deltas, and is the gripper command. This decouples learning from the exact robot configuration, enabling cross-embodiment by focusing the policy on local contact adjustment from tactile feedback. Several quality checks are applied to every collected trajectory. Empty or corrupted trajec”
  • Authors: amirhosein-alian; yongqiang-zhao; shiyi-gu; et al.

EA-SENSORERR-READ-0007

  • Claim: 在视觉遮挡或视觉退化下，显式把触觉接触投影到图像域可以改善空间对齐；但这种收益依赖对运动学和标定误差导致的空间不确定性建模。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.08765 RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation
  • Locator: Abstract (full-text section)
  • Evidence: 作者称视觉观测不可靠或被遮挡时，稀疏异构触觉与稠密视觉表示的对齐是核心挑战；方法使用正运动学和相机标定投影触觉传感器位置，并用力调制高斯 saliency maps 建模运动学和标定误差带来的空间不确定性。
  • Quote: “We then render force-modulated Gaussian saliency maps to model spatial uncertainty arising from kinematic and calibration errors.”
  • Authors: shengcheng-luo

EA-SENSORERR-READ-0015

  • Claim: 如果目标包含扰动恢复，数据集必须显式收集nominal demonstrations和recovery interaction data；否则模型很难学习接触丢失后的再建立。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.11184 TacForeSight: Force-Guided Tactile World Model for Contact-Rich Manipulation
  • Locator: IV-B 2 Perturbation-Aware Evaluation
  • Evidence: TacForeSight在perturbation-aware设置中额外收集恢复示教，让外部扰动发生在执行中并要求示教者重新建立稳定接触；完整模型在三个扰动任务上报告90%、85%、85%平均完成/成功分数。
  • Quote: “Policies in this setting are trained using both nominal demonstrations and recovery interaction data.”
  • Authors: yujie-zang; yuhang-zheng; xian-nie; et al.

EA-SENSORERR-READ-0003

  • Claim: 触觉不是简单加 token 就能提升；接触任务中的 RGB 未来可能视觉上合理但物理上不完整，而无约束触觉注入还可能污染视频和动作预测。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.26663 Tactile-WAM: Touch-Aware World Action Model with Tactile Asymmetric Attention
  • Locator: Abstract (full-text section)
  • Evidence: 作者指出 insertion、assembly、search、reorientation 依赖 slip、jamming、contact normals 和小对齐误差，这些状态在 RGB 中弱可见或不可见；同时他们定义 tactile pollution：无约束触觉 token 注入会迫使视觉 dynamics model 吸收稀疏局部事件式接触信号，从而退化视频和动作预测。
  • Quote: “In contact-rich manipulation, however, visually plausible futures can be physically incomplete: insertion, assembly, search, and reorientation often depend on slip, jamming, contact normals, or small alignment errors that are weakly visible or hidden in RGB. A natural solution is to predict future tactile states, however, we identify tactile pollution , a failure mode where unconstrained tactile-token injection degrades video and action prediction by forcing a visual dynamics model to absorb spa”
  • Authors: siyu-wu

EA-SENSORERR-READ-0004

  • Claim: 力觉/触觉/音频能揭示图像不可直接观测的交互状态；但这些模态硬件和任务依赖强，所以需要在少量多传感数据上适配既有视觉策略，而不是预训练时穷尽所有传感器。
  • Stance: conditional | Confidence: direct
  • Paper: 2606.30988 Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to Force
  • Locator: Abstract (full-text section)
  • Evidence: 作者称接触丰富任务常依赖 vision 之外的 sensory data，force、tactile 或 audio feedback 能揭示 images 中不可直接观察的 interaction states；但这些模态 hardware- and task-specific，且大规模多传感数据稀缺。他们提出 MuSe，将 limited multisensory data 融入 pretrained vision-only policies，并以 force-torque sensing 做真实任务案例。
  • Quote: “Abstract Robot manipulation often depends on sensory data beyond vision, especially in contact-rich tasks where force, tactile, or audio feedback reveals interaction states not directly visible from images. Yet such modalities are hardware- and task-specific, and large multisensory datasets remain scarce, making it impractical to pretrain policies with every sensor they may encounter. We study multi-sensory continual learning : adapting a pretrained robot policy to new tasks with newly introduce”
  • Authors: jaden-clark; changhao-wang; yihuai-gao; et al.

EA-SENSORERR-READ-0002

  • Claim: 全局视觉异常、帧级变化或策略不确定性不足以判断感知误差是否会影响当前动作；部署监控需要把异常限定到 action chunk 将要使用的执行走廊。
  • Stance: limit | Confidence: direct
  • Paper: 2606.16690 PATCH: Action-Chunk-Conditioned Latent Patch Innovation Monitoring for Robot Manipulation
  • Locator: Abstract (full-text section)
  • Evidence: 作者指出开放工作空间中移动物体、瞬时遮挡和目标运动附近扰动会让部署脆弱；现有 runtime monitors 往往依赖全局 observation anomalies、policy uncertainty 或 frame-level visual changes，难以区分任务相关执行风险和无害视觉变化。PATCH 通过 active action chunk 的 projected execution corridor 累计持续残差作为介入信号。
  • Quote: “Abstract Learning-based manipulation policies have made substantial progress in real-world robot manipulation, particularly for short-horizon action generation. However, deployment in open workspaces remains fragile under unexpected local scene dynamics, such as moving objects, transient occlusions, or disturbances near the intended motion. Existing runtime monitors often rely on global observation anomalies, policy uncertainty, or frame-level visual changes, and struggle to distinguish task-rel”
  • Authors: yanan-zhou; ranpeng-qiu; yincong-chen; et al.

EA-SENSORERR-READ-0001

  • Claim: TACO 用触觉感知世界模型联合预测未来视频和力序列，再将真实失败附近状态转成带纠正动作的想象片段，用于接触丰富任务的 VLA 后训练。
  • Stance: limit | Confidence: direct
  • Paper: 2607.02840 TACO: TActile World Model as a Self-COrrector forScalable VLA Post-Training
  • Locator: 5 Conclusion and Limitations
  • Evidence: 结论的 Recognize–Imagine–Label 回路明确连接了真实失败、视频—力联合想象与纠正动作标注。
  • Quote: “We presented TACO, a tactile-aware world-model-driven framework for scalable VLA post-training in contact-rich manipulation. Following a Recognize–Imagine–Label loop, TACO converts real-world failures into imagined corrections without repeated human intervention: a tactile-aware world model jointly denoises future video and force sequences, while a unified progress-action model recognizes failure-adjacent states and labels imagined segments with corrective actions. To incorporate this supervisio”
  • Authors: shengbang-liu; yueru-jia; yuyang-yan; et al.

EA-SENSORERR-READ-0005

  • Claim: 只看任务完成会低估传感器感知误差的真实风险；柔性物操作需要把安全交互、滑移/掉落和过度形变作为独立评测目标。
  • Stance: limit | Confidence: direct
  • Paper: 2607.04234 SoftVTBench: A Safety-Aware Visuo-Tactile Benchmark for Physically Constrained Robotic Manipulation of Deformable Objects
  • Locator: 1 Introduction
  • Evidence: 作者指出现有 manipulation benchmarks 多以 success 为中心，很少评估执行过程是否物理安全；SoftVTBench 分开报告 Goal Success 和 Safety Success，后者要求无掉落并限制峰值形变。实验显示 success-only evaluation 会显著高估策略表现，而触觉感知可改善 Safety Success 并降低物体形变。
  • Quote: “Experiments show that success-only evaluation substantially overstates policy performance, as a large fraction of goal-completing rollouts violate physical safety, and that adding tactile sensing improves Safety Success while keeping Goal Success comparable and reduces object deformation during execution.”
  • Authors: bowen-jing; mingxin-wang; ruiyang-hao; et al.

EA-SENSORERR-READ-0006

  • Claim: 世界模型/生成式仿真器不能仅凭视觉逼真度作为具身策略评测裁判；必须验证其是否按动作正确响应，并建立 admissibility/validation 梯度后才能把闭环判决当证据。
  • Stance: gap | Confidence: direct
  • Paper: 2607.07196 Validate the Dream Before You Trust Its Verdict: Admissibility for World-Model Simulators
  • Locator: Abstract (full-text section)
  • Evidence: 作者指出机器人中 World Models 越来越被用于模拟动作后果并给出 success/safety verdict，但视频生成指标如 FVD 奖励视觉真实感，却忽略世界是否对 policy actions 正确响应；他们主张作为 test oracle 的 WM 需要先通过 accreditation，并提出 L0-L4 admissibility ladder。
  • Quote: “Abstract Across robotics, World Models (WMs) are increasingly used to evaluate action policies by simulating the consequences of actions in an imagined world, and returning a success or safety verdict. Yet a verdict is only as trustworthy as the WM that produced it, and the WM itself needs to be certified. In video-generation WMs , fidelity metrics such as Fréchet Video Distance (FVD) reward visual realism, but ignore whether the world responds correctly to the policy’s actions, including those”
  • Authors: christian-oefinger; finn-rasmus-schfer; korbinian-moller; et al.

References

Interactive Wiki

进入交互阅读

静态页采用默认版本；v0、v0、v0可在同一交互 Wiki 中阅读，不建立相互竞争的索引页。

用 AI 继续研究 v0 v0 v0

Method and limits

研究方法、证据边界与引用说明

本页由当前结算的证据层自动派生，不改写已结算 run。论文只有在完整非 OCR 全文、结构化论文笔记和 claim-support audit 通过后，才进入接受证据。

页面结论是对所列论文与研究窗口的综合，不等同于无限外推。引用本专题时，请同时保留本页 canonical 地址、访问日期，并在需要时回溯原论文。