Website Rendering

A public website URL to render in a headless browser. Must include http:// or https://.

Example:

https://example.com

Choosing the right engine:

• Static HTML already in the page? Try Website Crawler first (1 credit, faster).
• This endpoint (Website Rendering) runs JavaScript and returns post-render HTML.
• Still blocked after rendering? Escalate to Website WebUnlocker if the domain is whitelisted.

See Website Scraping guide for a full comparison.

Number of seconds to wait after page load before returning the rendered HTML. Useful for pages with delayed rendering or animations.

Notes:

• Increasing this value adds latency to every request. Use only when a page's content loads after a delay.

A CSS or XPath selector to wait for before returning the rendered HTML. The headless browser will hold the response until the specified element appears in the DOM.

Supported selector types:

• ID selector: #loading-container
• Class selector: .content-loaded
• Combined selector: div.main-content#user-profile

Example:

wait_for=#loading-container

Notes:

• If the element never appears, the request will time out according to the timeout parameter.

Controls whether the headless browser should block ad requests during rendering.

• false: Ads are loaded normally (default)
• true: Ad network requests are blocked, resulting in cleaner HTML and faster rendering

Notes:

• Blocking ads can speed up rendering on ad-heavy pages and reduce noise in the extracted HTML.

Maximum number of seconds to wait for the page to fully load before returning whatever has been rendered so far.

• Accepts integer values representing seconds

Notes:

• Setting a lower timeout may result in incomplete HTML for slow-loading pages.
• Combine with wait_for to ensure critical elements are present before the timeout fires.

JSON array sent in the POST body (not a query string, not a stringified JSON string).

status.computer browser workers only execute instructions when this field is a real array (browser_instructions / browserInstructions).

A JSON array of browser navigation instructions to execute sequentially during page rendering. Allows controlling scrolling and other browser actions to trigger dynamic content loading or simulate human behavior.

Currently supports two instruction types:

• scroll: Scrolls the page by a precise number of pixels (horizontally and/or vertically)
• scroll_to_bottom: Automatically scrolls to the bottom of the page

Instruction type: scroll

Parameters:

• type: "scroll"
• x: Pixels to scroll horizontally (positive = right, negative = left)
• y: Pixels to scroll vertically (positive = down, negative = up)
• duration (optional): Duration in seconds for smooth scrolling. Default: 0 (instant)
• wait_time_s (optional): Seconds to wait after the instruction completes. Default: 0

Example payload:

{    "type": "scroll",    "x": 0,    "y": 4115,    "duration": 5,    "wait_time_s": 2}

Instruction type: scroll_to_bottom

Parameters:

• type: "scroll_to_bottom"
• duration (optional): Duration in seconds for smooth scrolling. Default: 0 (instant)
• wait_time_s (optional): Seconds to wait after the instruction completes. Default: 0

Example payload:

{    "type": "scroll_to_bottom",    "duration": 3,    "wait_time_s": 2}

Full request example (multiple instructions):

{    "query": "https://www.comparably.com/companies/airbus",    "wait_for": "#ng-state",    "browser_instructions": [        {"type": "scroll", "x": 0, "y": 1000, "duration": 2, "wait_time_s": 1},        {"type": "scroll", "x": 0, "y": 2000, "duration": 3, "wait_time_s": 1},        {"type": "scroll_to_bottom", "duration": 4, "wait_time_s": 2}    ]}

Notes:

• Execution order: Instructions are executed sequentially in the specified order
• Error handling: If one instruction fails, subsequent ones continue to execute
• Smooth scrolling (duration > 0) takes more time but better simulates human behavior and avoids bot detection
• Increase timeout when using instructions with significant cumulative durations