Sipply
每日摘要

研究约 1 分钟阅读最近更新

NormAct：评估具身规划中隐性社会规范遵循的基准NormAct: A Benchmark for Hidden Social Norm Compliance in Embodied Planning

1 家来源 · 1 篇报道 — 来源较集中（请仔细核对）

以下内容为 AI 自动翻译，英文原文附后供参考。

摘要

研究人员推出了NormAct，这是一个新的基准，旨在评估多模态大型语言模型（MLLMs）在具身规划过程中如何遵循隐性社会规范。该基准旨在填补对AI系统中目标实现与社会规范遵循之间相互作用的关键理解空白。初步实验显示，这些模型在满足明确目标与遵循潜在社会规范之间存在显著差距，突显了改进检测和整合这些规范到AI规划过程中的必要性。

Researchers have introduced NormAct, a new benchmark designed to evaluate how multimodal large language models (MLLMs) comply with hidden social norms during the process of embodied planning. The benchmark aims to fill a critical gap in understanding the interplay between goal achievement and social norm adherence in AI systems. Initial experiments reveal a significant disparity between the ability of these models to meet explicit objectives and their compliance with underlying social norms, highlighting the necessity for improved mechanisms for detecting and integrating these norms into AI planning processes.

要点

  1. NormAct基准关注AI中的隐性社会规范遵循。

    NormAct benchmark focuses on hidden social norm compliance in AI.

  2. 初步实验显示目标实现与规范遵循之间存在差距。

    Initial experiments show a gap between goal achievement and norm adherence.

  3. 需要更好地检测和整合社会规范到AI规划中。

    There is a need for better detection and integration of social norms in AI planning.

为何重要

NormAct基准的推出具有重要意义，因为它解决了影响现实应用的AI行为的关键方面，确保AI系统不仅有效运作，还能在社会背景中伦理地运作。

The introduction of the NormAct benchmark is significant as it addresses a critical aspect of AI behavior that impacts real-world applications, ensuring that AI systems operate not only effectively but also ethically within social contexts.

按谁的角度看

产品经理

对于产品经理来说，理解NormAct基准至关重要，因为它可以指导开发既以目标为导向又具社会意识的AI产品，从而增强用户信任和满意度。

For product managers, understanding the NormAct benchmark is crucial as it can guide the development of AI products that are not only goal-oriented but also socially aware, enhancing user trust and satisfaction.

开发者

开发人员和工程师应关注NormAct，因为它提供了将社会规范整合到AI系统中的复杂性洞察，这可以提高他们模型在多样化环境中的稳健性和适用性。

Developers and engineers should pay attention to NormAct as it provides insights into the complexities of integrating social norms into AI systems, which can improve the robustness and applicability of their models in diverse environments.

学生与求职者

对于学生和求职者来说，熟悉像NormAct这样的基准可以增强他们对AI伦理和合规的理解，使他们在专注于负责任的AI开发的就业市场中更具竞争力。

For students and job-seekers, familiarity with benchmarks like NormAct can enhance their understanding of AI ethics and compliance, making them more competitive in the job market focused on responsible AI development.

覆盖来源

来源标题与摘录保留原文，以便核对与追溯。

  • arXiv cs.AI

    NormAct: A Benchmark for Hidden Social Norm Compliance in Embodied Planning

    Researchers introduced NormAct, a benchmark to assess how multimodal large language models (MLLMs) adhere to hidden social norms while pursuing explicit goals. Experiments indicate a notable gap between achieving goals and complying with these norms, underscoring the need for enhanced detection and integration mechanisms in AI planning.