用 NVIDIA GPUDirect Storage 在 Python 中将数据读入 GPU 显存
原标题:How to Read Data into GPU Memory in Python with NVIDIA GPUDirect Storage
AI 摘要
NVIDIA 技术博客发布教程,介绍如何通过 NVIDIA KvikIO 的 Python API 将数据直接读入 GPU 显存,利用 GPUDirect Storage(GDS)绕过 CPU 内存中转。文章说明了 KvikIO、cuFile 与 GDS 的分层关系及路径选择机制,并给出环境配置、读取操作与验证加速路径是否生效的步骤。该教程面向使用 Python 的 AI 开发者,旨在降低高效 GPU 数据 I/O 的使用门槛。
正文节选
GPU applications are processing ever-growing datasets with increasingly powerful accelerators. According to the 2025 Stanford AI Index, compute for notable AI models has been doubling approximately every five months, while the size of datasets used to train LLMs has been doubling approximately every eight months. As computation and data scale together, moving data efficiently from storage becomes a necessity for keeping accelerators supplied. NVIDIA Magnum IO GPUDirect Storage (GDS) addresses th