High performance API for web scraping to scrape any website and get the HTML (browser rendering) with browser instructions
http
or https
protocol.0
and 30
. The Piloterr headless browsers will then wait the duration of the time set in seconds before returning the page’s HTML.wait_for=#loading-container
wait_for=.content-loaded
wait_for=div.main-content#user-profile
true
to block ads.scroll
scroll_to_bottom
scroll
)type
: "scroll"
x
: Number of pixels to scroll horizontally (positive = right, negative = left)y
: Number of pixels to scroll vertically (positive = down, negative = up)duration
: (optional) Duration in seconds for smooth scrolling (default: 0 = instant)wait_time_s
: (optional) Wait time in seconds after the instruction (default: 0)scroll_to_bottom
)type
: "scroll_to_bottom"
duration
: (optional) Duration in seconds for smooth scrolling (default: 0 = instant)wait_time_s
: (optional) Wait time in seconds after the instruction (default: 0)browser_instructions
parameter to your request with a list of instructions:
duration
parameter controls the smoothness of scrolling:
duration: 0
(default): Instant scroll, immediate movement to final positionduration: > 0
: Progressive scroll over the specified duration
timeout
if using significant durationsduration > 0
) takes more time but better simulates human behavior