obsidian/技术支持/Tools指南/Firecrawl/查看操作实例.md

---

notion-id: 251ca4d7-cb7b-803d-883d-fe0d24b3c9

https://docs.firecrawl.dev/api-reference/endpoint/crawl-post?playground=open

• Scrape → 单页抓取
• Crawl → 全站爬取
• Map → 网站结构
• Search → 搜索功能
• Extract → 数据提取
• Account → 账户/使用情况

网页查看抓取记录

#查看操作记录
http://40.233.18.33:3002/admin/19841122Cy!/queues

查看单个抓取记录

#查看操作记录
curl --request GET \
  --url http://40.233.18.33:3002/v1/crawl/6e18d18b-51f5-41a7-adf4-4a975bea4c54 \
  --header 'Authorization: Bearer 123456789'

抓取全局网页

#抓取页面
curl --request POST \
  --url http://40.233.18.33:3002/v1/crawl \
  --header 'Authorization: Bearer 123456789' \
  --header 'Content-Type: application/json' \
  --data '{
  "maxDepth": 2,
  "ignoreSitemap": false,
  "ignoreQueryParameters": false,
  "limit": 10000,
  "allowBackwardLinks": false,
  "crawlEntireDomain": false,
  "allowExternalLinks": false,
  "allowSubdomains": false,
  "scrapeOptions": {
    "formats": [
      "markdown"
    ]
  },
  "zeroDataRetention": false,
  "url": "https://www.3dmgame.com/"
}'

抓取地图

curl --request POST \
  --url http://40.233.18.33:3002/v1/map \
  --header 'Authorization: Bearer 123456789' \
  --header 'Content-Type: application/json' \
  --data '{
  "ignoreSitemap": false,
  "sitemapOnly": false,
  "includeSubdomains": true,
  "limit": 5000,
  "url": "https://www.3dmgame.com/"
}'