Crawl status
GET/crawl/{crawler_uuid}/status
Retrieve the current status and progress of a crawler job. Use this endpoint to poll for updates while the crawler is running.
curl -X POST https://api.orthogonal.com/v1/run \
-H 'Authorization: Bearer orth_live_••••' \
-H 'Content-Type: application/json' \
-d '{
"api": "scrapfly",
"path": "",
"method": "GET"
}'
{
"success": true,
"data": {
"env": "LIVE",
"urls": { … },
"links": {},
"state": { … },
"search": { … },
"status": "RUNNING",
"project": "default",
"refresh": { … },
"user_uuid": "d827a6dd-d8c6-4af6-ad56-d29e7efd661a",
"is_success": false,
"is_finished": false,
"crawler_uuid": "ac9236fd-191c-4164-98a5-729aa4b3bee0"
}
}
A real response, recorded when Orthogonal checked this endpoint.
Free
Path parameters
More from Scrapfly
- Crawl cancelPOST/crawl/{crawler_uuid}/cancelFree
- Crawl searchGET/crawl/{crawler_uuid}/search$0.000164 per call
- Web scrape headers onlyHEAD/scrape$0.000164 per call
- Crawl archive downloadGET/crawl/{crawler_uuid}/artifactFree
- Web scrape OPTIONS requestOPTIONS/scrape$0.000164 per call
- Crawled page contentGET/crawl/{crawler_uuid}/contentsFree
- Crawl structured extractionPOST/crawl/extract$0.000491 per call
- Website crawlPOST/crawl$0.000164 per call
- Multi-crawl searchPOST/crawl/search$0.000164 per call
- Crawled URL listGET/crawl/{crawler_uuid}/urlsFree
- Multi-crawl question answeringPOST/crawl/prompt$0.000491 per call
- Web scrape with POST bodyPOST/scrape$0.000164 per call