# Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models

Published: 2026-07-28 · Updated: 2026-07-28 · Category: Research

Source page: https://www.sipply.dev/story/do-vlms-read-or-rewrite-on-transcription-faithfulness-in-25ccbf54 · 中文: https://www.sipply.dev/zh/story/do-vlms-read-or-rewrite-on-transcription-faithfulness-in-25ccbf54

## Summary

A recent study published on arXiv delves into the transcription capabilities of Vision Language Models (VLMs) and their performance relative to traditional Optical Character Recognition (OCR) systems. The research highlights a significant finding: VLMs tend to rewrite text rather than transcribe it accurately, which raises questions about their reliability in tasks requiring precise text extraction. To address this issue, the authors have introduced a new benchmark called FaithC4, designed to assess the performance of different systems when faced with text perturbations, thereby providing a more comprehensive evaluation of transcription faithfulness.

## Key takeaways

- VLMs often rewrite text instead of providing faithful transcriptions.
- The introduction of the FaithC4 benchmark aims to improve evaluation standards for transcription accuracy.
- The findings challenge the perceived reliability of VLMs in text extraction tasks.

## Why it matters

This research is significant as it sheds light on the limitations of VLMs in transcription tasks, which are critical for applications in various fields such as document processing and accessibility technologies.

- **Product managers:** For product managers, understanding the transcription capabilities and limitations of VLMs is crucial for making informed decisions about integrating these models into products that rely on accurate text extraction.
- **Developers:** Developers and engineers should consider the findings when implementing VLMs in applications, as the tendency to rewrite text could lead to inaccuracies in data processing and user experience.
- **Students and job seekers:** For students and job-seekers, this research highlights the importance of understanding the strengths and weaknesses of emerging AI technologies, which can influence career opportunities in AI development and research.

## Sources

- [Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models](https://arxiv.org/abs/2607.21617) (arXiv cs.AI, 2026-07-28)

## 中文

### VLMs是阅读还是重写？关于视觉语言模型中的转录忠实度

最近在arXiv上发表的一项研究探讨了视觉语言模型（VLMs）的转录能力及其与传统光学字符识别（OCR）系统的表现。研究强调了一个重要发现：VLMs往往重写文本而不是准确转录，这引发了对其在需要精确文本提取任务中的可靠性问题。为了解决这个问题，作者引入了一个新的基准测试FaithC4，旨在评估不同系统在面对文本扰动时的表现，从而提供更全面的转录忠实度评估。

**要点：**

- VLMs通常重写文本，而不是提供忠实的转录。
- 引入FaithC4基准测试旨在提高转录准确性的评估标准。
- 研究结果挑战了对VLMs在文本提取任务中可靠性的看法。

**为什么重要：** 这项研究的重要性在于揭示了VLMs在转录任务中的局限性，这对文档处理和无障碍技术等多个领域的应用至关重要。

---
Sipply: Sip AI News Simply. https://www.sipply.dev