Multi-crawl search

POST/crawl/search

One or many crawls. The collection is crawlids in the request body. Returns ranked passages with the URL they came from and a link back to the full page.

Listed by OrthogonalPublished by ScrapflyPublisher docs
curl -X POST https://api.orthogonal.com/v1/run \
-H 'Authorization: Bearer orth_live_••••' \
-H 'Content-Type: application/json' \
-d '{
"api": "scrapfly",
"path": "/crawl/search",
"method": "POST",
"body": {
"query": "",
"crawl_ids": [
""
],
"limit": ,
"mode": "",
"filters":
}
}'
{
"success": true,
"data": {
"mode": "hybrid",
"limit": 1,
"query": "product",
"stats": { … },
"theta": null,
"crawls": [],
"cursor": null,
"results": [],
"skipped": [ 1 item ],
"api_credit": 0,
"completeness": "exact",
"crawls_failed": [],
"crawls_searched": 0,
"crawls_requested": 1,
"max_ub_unsearched": null,
"crawls_pruned_exact": 0,
"crawls_skipped_deadline": []
}
}
A real response, recorded when Orthogonal checked this endpoint.

$0.000164per call

Body parameters

More from Scrapfly

  1. Crawl cancelPOST/crawl/{crawler_uuid}/cancelFree
  2. Crawl searchGET/crawl/{crawler_uuid}/search$0.000164 per call
  3. Web scrape headers onlyHEAD/scrape$0.000164 per call
  4. Crawl archive downloadGET/crawl/{crawler_uuid}/artifactFree
  5. Web scrape OPTIONS requestOPTIONS/scrape$0.000164 per call
  6. Crawled page contentGET/crawl/{crawler_uuid}/contentsFree
  7. Crawl structured extractionPOST/crawl/extract$0.000491 per call
  8. Website crawlPOST/crawl$0.000164 per call
  9. Crawl statusGET/crawl/{crawler_uuid}/statusFree
  10. Crawled URL listGET/crawl/{crawler_uuid}/urlsFree
  11. Multi-crawl question answeringPOST/crawl/prompt$0.000491 per call
  12. Web scrape with POST bodyPOST/scrape$0.000164 per call
All 20 Scrapfly endpoints