Web scrape headers only

HEAD/scrape

Scrapfly Scrape API (HEAD): sends a HEAD request to the target URL through Scrapfly's proxies, with the same proxy, anti-bot and rendering options as the other scrape methods; returns only response headers, no body.

Listed by OrthogonalPublished by ScrapflyPublisher docs
curl -X POST https://api.orthogonal.com/v1/run \
-H 'Authorization: Bearer orth_live_••••' \
-H 'Content-Type: application/json' \
-d '{
"api": "scrapfly",
"path": "/scrape",
"method": "HEAD",
"query": {
"url": ""
}
}'

Changes with the parameters.

$0.000164per callUp to $0.1635 depending on the options.

Query parameters

More from Scrapfly

  1. Crawl cancelPOST/crawl/{crawler_uuid}/cancelFree
  2. Crawl searchGET/crawl/{crawler_uuid}/search$0.000164 per call
  3. Crawl archive downloadGET/crawl/{crawler_uuid}/artifactFree
  4. Web scrape OPTIONS requestOPTIONS/scrape$0.000164 per call
  5. Crawled page contentGET/crawl/{crawler_uuid}/contentsFree
  6. Crawl structured extractionPOST/crawl/extract$0.000491 per call
  7. Website crawlPOST/crawl$0.000164 per call
  8. Crawl statusGET/crawl/{crawler_uuid}/statusFree
  9. Multi-crawl searchPOST/crawl/search$0.000164 per call
  10. Crawled URL listGET/crawl/{crawler_uuid}/urlsFree
  11. Multi-crawl question answeringPOST/crawl/prompt$0.000491 per call
  12. Web scrape with POST bodyPOST/scrape$0.000164 per call
All 20 Scrapfly endpoints