Crawl structured extraction

POST/crawl/extract

The same retrieval as /crawl/prompt with a structured answer: supply a JSON Schema and get back an object that conforms to it.

Listed by OrthogonalPublished by ScrapflyPublisher docs
curl -X POST https://api.orthogonal.com/v1/run \
-H 'Authorization: Bearer orth_live_••••' \
-H 'Content-Type: application/json' \
-d '{
"api": "scrapfly",
"path": "/crawl/extract",
"method": "POST",
"body": {
"prompt": "",
"schema": {
"type": "",
"properties": {
"products": {
"type": "",
"items": {
"type": ""
}
}
}
},
"crawl_ids": [
""
],
"search": {
"limit":
}
}
}'
{
"success": true,
"data": {
"data": { … },
"prompt": "List the product names.",
"search": { … },
"sources": [ 1 item ],
"truncated": false,
"sources_used": [],
"sources_dropped": 0
}
}
A real response, recorded when Orthogonal checked this endpoint.

$0.000491per call

Body parameters

More from Scrapfly

  1. Crawl cancelPOST/crawl/{crawler_uuid}/cancelFree
  2. Crawl searchGET/crawl/{crawler_uuid}/search$0.000164 per call
  3. Web scrape headers onlyHEAD/scrape$0.000164 per call
  4. Crawl archive downloadGET/crawl/{crawler_uuid}/artifactFree
  5. Web scrape OPTIONS requestOPTIONS/scrape$0.000164 per call
  6. Crawled page contentGET/crawl/{crawler_uuid}/contentsFree
  7. Website crawlPOST/crawl$0.000164 per call
  8. Crawl statusGET/crawl/{crawler_uuid}/statusFree
  9. Multi-crawl searchPOST/crawl/search$0.000164 per call
  10. Crawled URL listGET/crawl/{crawler_uuid}/urlsFree
  11. Multi-crawl question answeringPOST/crawl/prompt$0.000491 per call
  12. Web scrape with POST bodyPOST/scrape$0.000164 per call
All 20 Scrapfly endpoints