Engine-Transfer-Bench:文档编译引擎选择的实证基准
原标题:Engine-Transfer-Bench: An Evidence-Based Benchmark for Document Compilation Engine Selection
AI 摘要
Engine-Transfer-Bench (ETB) 是一个用于文档编译引擎选择的新基准,包含 1,784 个开放文档和四个任务(可靠性、延迟、文本一致性、失败模式),并在 macOS、Ubuntu 和 Windows 上进行了跨平台测试。研究发现 Tectonic 的成功率稳定在 96.3-97.2%,而经典 TeX Live 引擎因发行版策略波动 12-20 个百分点;失败集中在 107 个引擎特定模板中,主要源于架构问题而非缺失包。ETB 还发布了 ETB-Porta 推荐器和跨操作系统测试工具,作为共享基础设施。
正文节选
Engine-Transfer-Bench: An Evidence-Based Benchmark for Document Compilation Engine SelectionCCS: Software and its engineering Software libraries and repositoriesCCS: Software and its engineering Software testing and debuggingCCS: Information systems Digital libraries and archives Abstract. There is no shared framework for selecting among document compilation engines (pdfLaTeX, XeLaTeX, LuaLaTeX, Tectonic, Typst, pandoc PDF backends). We present Engine-Transfer-Bench (ETB): 1,784 open documents,