Pruna AI 发布基于 pruna 优化的测试模型
原标题:pruna-test/test-save-tiny-random-llama3-smashed-pro
AI 摘要
Pruna AI 在 Hugging Face 上发布了一个名为 pruna-test/test-save-tiny-random-llama3-smashed-pro 的测试模型,该模型基于 tiny-random-Llama3 并使用其开源模型优化框架 pruna 生成。模型卡片提供了通过 pruna_pro 库加载模型的代码示例,并附带了 smash_config.json 压缩配置,但配置中所有优化方法均未启用。该发布主要用于展示 Pruna 的模型优化与保存流程,实际技术信息量有限。
正文节选
--- library_name: transformers tags: - pruna_pro-ai - pruna-ai - safetensors --- # Model Card for pruna-test/test-save-tiny-random-llama3-smashed-pro This model was created using the [pruna](https://github.com/PrunaAI/pruna) library. Pruna is a model optimization framework built for developers, enabling you to deliver more efficient models with minimal implementation overhead. ## Usage First things first, you need to install the pruna library: ```bash pip install pruna_pro ``` You can [use