Website
Website Crawler
High performance API for web scraping to scrape any website and get the HTML (request mode)
GET
/
api
/
v2
/
website
/
crawler
If you need to scrape a website, Piloterr’s Website Crawler API is the perfect solution. It’s a high-performance API that can scrape any website and return the HTML content. You can use it to scrape any website.
If you are interested in js rendering, please see the Website Rendering API.
Contact us if you need help or have any questions.
Header
x-api-key
string
requiredThis parameter specifies the private key you’ll need for Piloterr access.
Parameters
query
string
A website URL with either the http
or https
protocol.
allow_redirects
boolean
If set to false
, do not follow redirects. true
by default.
return_page_source
boolean
If set to false
, the response will be a JSON object with the response body of the page. false
by default.
Response
Was this page helpful?