GET
/
api
/
v2
/
website
/
crawler

If you need to scrape a website, Piloterr’s Website Crawler API is the perfect solution. It’s a high-performance API that can scrape any website and return the HTML content. You can use it to scrape any website.

If you are interested in js rendering, please see the Website Rendering API.

Contact us if you need help or have any questions.

x-api-key
string
required

This parameter specifies the private key you’ll need for Piloterr access.

Parameters

query
string

A website URL with either the http or https protocol.

allow_redirects
boolean

If set to false, do not follow redirects. true by default.

return_page_source
boolean

If set to false, the response will be a JSON object with the response body of the page. false by default.

Response