用 Crawl4AI 为 Amazon Bedrock 知识库准备网页内容
原标题：Prepare web content for Amazon Bedrock Knowledge Bases with Crawl4AI
AI 摘要
AWS 博客介绍如何用开源 Python 爬虫 Crawl4AI 为 Amazon Bedrock Knowledge Bases 准备网页内容：当内置 Web Crawler 连接器无法满足需求时，可用 Crawl4AI 抓取页面、提取正文并生成 Markdown 与元数据 sidecar 写入 S3，再由知识库通过 S3 数据源摄取。文章给出基于 ECS Fargate、EventBridge 和 CDK 的批量摄取工作流，并说明该方案仅处理公开页面、不涉及推理时实时联网。
正文节选
Prepare web content for Amazon Bedrock Knowledge Bases with Crawl4AI When you build Retrieval Augmented Generation (RAG) applications, answer quality depends on the data that you ingest. Amazon Bedrock Knowledge Bases is the fully managed RAG capability of Amazon Bedrock. With Amazon Bedrock Managed Knowledge Base, you connect your data sources, and Amazon Bedrock manages ingestion, storage, indexing, and retrieval for you. You don’t provision or scale a vector store, and embedding and reranking