Camel AI | Firecrawl

安装

pip install camel-ai

使用

通过 Camel AI 和 Firecrawl，你可以快速构建使用网络数据的多代理系统。

使用 Firecrawl 抓取整个网站

mock_app = MockFirecrawlApp.return_value
firecrawl = Firecrawl(
    api_key='FC_API_KEY', api_url='https://api.test.com'
)
url = 'https://example.com'
response = [{'markdown': 'Markdown content'}]
mock_app.crawl_url.return_value = respons
result = firecrawl.markdown_crawl(url)

使用 Firecrawl 抓取单个页面

mock_app = MockFirecrawlApp.return_value
firecrawl = Firecrawl(
    api_key='test_api_key', api_url='https://api.test.com'
)
url = 'https://example.com'
response = 'Scraped content'
mock_app.scrape_url.return_value = response

result = firecrawl.scrape(url)