Webscraping ai
Overview
SLUG: WEBSCRAPING_AI
Description
WebScraping.AI provides an API for web scraping with features like Chrome JS rendering, rotating proxies, and HTML parsing.
Authentication Details
API Key
Connecting to Webscraping ai
Create an auth config
Use the dashboard to create an auth config for the Webscraping ai toolkit. This allows you to connect multiple Webscraping ai accounts to Composio for agents to use.
Select App
Navigate to [Webscraping ai](https://platform.composio.dev?next_page=/marketplace/Webscraping ai).
Create and Get auth config ID
Click “Create Webscraping ai Auth Config”. After creation, copy the displayed ID starting with ac_
. This is your auth config ID. This is not a sensitive ID — you can save it in environment variables or a database.
This ID will be used to create connections to the toolkit for a given user.
Connect Your Account
Using API Key
Tools
Executing tools
To prototype you can execute some tools to see the responses and working on the [Webscraping ai toolkit’s playground](https://app.composio.dev/app/Webscraping ai)
OpenAI (Python)
Anthropic (TypeScript)
Google (Python)
Vercel (TypeScript)
Tool List
WEBSCRAPING_AI_ACCOUNT_INFO
Tool Name: Get account usage and quota
Description
Action Parameters
Action Response
WEBSCRAPING_AI_GET_HTML
Tool Name: Retrieve HTML Content
Description
Action Parameters
Action Response
WEBSCRAPING_AI_GET_RENDERED_HTML
Tool Name: Get Rendered HTML
Description
Action Parameters
Action Response
WEBSCRAPING_AI_GET_TEXT
Tool Name: Get Text
Description
Action Parameters
Action Response