用 AI 代理将 Apache Spark UDF 重写为 GPU 加速
原标题：How to Rewrite Apache Spark UDFs for GPU Acceleration with AI Agents
AI 摘要
NVIDIA 技术博客介绍如何利用 AI 编码代理将 Apache Spark 中的用户自定义函数（UDF）重写为 GPU 加速版本。文章指出 UDF 会破坏 Spark 的声明式抽象，导致数据在 GPU 与 CPU 间往返并丧失并行加速，而通过 SQL、cuDF 的 RapidsUDF 接口或 CUDA 内核三种方式重写可消除回退开销，实现 22 倍以上加速。NVIDIA 还推出 cuDF skills for Apache Spark，帮助代理完成测试、基准测试到集成的端到端重写流程。
正文节选
Enterprise applications have become increasingly demanding. Agentic AI has compounded the need for vast amounts of enterprise data with frequent, complex queries across increasingly large datasets. Meeting that demand requires greater data throughput without a proportional increase in cost. NVIDIA cuDF addresses this challenge by leveraging the massive parallelism and high-bandwidth memory of GPUs for data analytics. Particularly, the NVIDIA cuDF plugin for Apache Spark brings this acceleration