Website Rendering
High performance API for web scraping to scrape any website and get the HTML (browser rendering)
If you need to scrape a website, Piloterr’s Website Crawler API is the perfect solution. It’s a high-performance API that can scrape any website and return the HTML content. You can use it to scrape any website, including those with JavaScript rendering, and bypass Cloudflare, Akamai, PerimeterX, and DataDome. The API is easy to use and requires only a website URL and an API key. You can also set parameters to control the API’s behavior, such as following redirects, waiting for JavaScript to render, and waiting for specific elements to appear in the DOM. The API is perfect for web scraping, data extraction, and content analysis.
This endpoint costs 2 credits per request. Contact us if you need help or have any questions.
Header
This parameter specifies the private key you’ll need for Piloterr access.
Parameters
A website URL with either the http or https protocol.
Some code-heavy websites need time to fully “render”. To direct Piloterr to wait before it returns the fully rendered HTML, use the wait parameter with a value in seconds between 0 and 20. The Piloterr headless browsers will then wait the duration of the time set in seconds before returning the page’s HTML.
It’s sometimes necessary to wait for a particular element to appear in the DOM before Piloterr returns the HTML content. Our headless browsers will wait for the CSS / Xpath selector passed in the parameter before returning the HTML. For example, to wait for the element <div class="loading-done"></div> use wait_for=.loading-done in your request.
By default, Piloterr block ads. This parameter is unnecessary if JavaScript rendering is disabled.
Response
Was this page helpful?