Scrape do
Overview
SLUG: SCRAPE_DO
Description
Scrape.do is a web scraping API offering rotating residential, data-center, and mobile proxies with headless browser support and session management to bypass anti-bot protections (e.g., Cloudflare, Akamai) and extract data at scale in formats like JSON and HTML.
Authentication Details
API Key
Connecting to Scrape do
Create an auth config
Use the dashboard to create an auth config for the Scrape do toolkit. This allows you to connect multiple Scrape do accounts to Composio for agents to use.
Create and Get auth config ID
Click “Create Scrape do Auth Config”. After creation, copy the displayed ID starting with ac_
. This is your auth config ID. This is not a sensitive ID — you can save it in environment variables or a database.
This ID will be used to create connections to the toolkit for a given user.
Connect Your Account
Using API Key
Tools
Executing tools
To prototype you can execute some tools to see the responses and working on the [Scrape do toolkit’s playground](https://app.composio.dev/app/Scrape do)
OpenAI (Python)
Anthropic (TypeScript)
Google (Python)
Vercel (TypeScript)
Tool List
SCRAPE_DO_GET_ACCOUNT_INFO
Tool Name: Get Account Information
Description
Action Parameters
Action Response
SCRAPE_DO_GET_RENDER_PAGE
Tool Name: Get rendered page content
Description
Action Parameters
Action Response
SCRAPE_DO_SCRAPE_DO_GET_PAGE
Tool Name: Scrape webpage using scrape.do
Description
Action Parameters
Action Response
SCRAPE_DO_SCRAPE_DO_PROXY_MODE
Tool Name: Use Scrape.do Proxy Mode
Description
Action Parameters
Action Response
SCRAPE_DO_SCRAPE_DO_SET_COOKIES
Tool Name: Set Cookies for Scraping
Description
Action Parameters
Action Response
SCRAPE_DO_SCRAPE_DO_SET_SUPER_MODE
Tool Name: Set Scrape.do Super Mode
Description
Action Parameters
Action Response
SCRAPE_DO_SET_BLOCK_URLS
Tool Name: Block specific URLs during scraping
Description
Action Parameters
Action Response
SCRAPE_DO_SET_CUSTOM_HEADERS
Tool Name: Set custom headers for scrape.do request
Description
Action Parameters
Action Response
SCRAPE_DO_SET_CUSTOM_WAIT
Tool Name: Set Custom Wait Time
Description
Action Parameters
Action Response
SCRAPE_DO_SET_DEVICE_TYPE
Tool Name: Set Device Type for Scraping
Description
Action Parameters
Action Response
SCRAPE_DO_SET_DISABLE_REDIRECTION
Tool Name: Set Disable Redirection
Description
Action Parameters
Action Response
SCRAPE_DO_SET_PURE_COOKIES
Tool Name: Set Pure Cookies Mode
Description
Action Parameters
Action Response
SCRAPE_DO_SET_REGIONAL_GEO_CODE
Tool Name: Set Regional Geolocation for Scraping
Description
Action Parameters
Action Response
SCRAPE_DO_SET_RETRY_TIMEOUT
Tool Name: Set Retry Timeout
Description
Action Parameters
Action Response
SCRAPE_DO_SET_SCREENSHOT
Tool Name: Set Screenshot Capture for Scraping
Description
Action Parameters
Action Response
SCRAPE_DO_SET_SESSION_ID
Tool Name: Set Session ID for Sticky Sessions
Description
Action Parameters
Action Response
SCRAPE_DO_SET_WAIT_FOR_SELECTOR
Tool Name: Set Wait For Selector
Description
Action Parameters
Action Response
SCRAPE_DO_SET_WAIT_UNTIL
Tool Name: Set Wait Until Condition
Description
Action Parameters
Action Response
SCRAPE_DO_SHOW_WEBSOCKET_REQUESTS
Tool Name: Monitor WebSocket requests using scrape.do
Description
Action Parameters
Action Response