Scrape.do MCP connector
Scrape.do is a web scraping API platform that provides structured, location-aware search engine data and website content through simple HTTP requests without handling proxies or CAPTCHA. The Scrape.do MCP connector allows AI agents to scrape websites synchronously, create and manage asynchronous scraping jobs, and retrieve job status and details. It also supports checking account information and monitoring usage statistics across your scraping operations.
Authentication type
- API Key - Requires a static API key to be configured before the agent can connect to the service.
Uses
Use the Scrape.do MCP connector to perform the following actions:
- Extract product prices and competitor data from e-commerce websites for market analysis
- Monitor search engine results and track keyword rankings across geo-targeted locations
- Collect structured data from multiple websites simultaneously using asynchronous jobs
- Gather real estate listings, job postings, and classified ads from public websites
- Validate web content changes and automate alerts when website data updates
- Build datasets for machine learning models by scraping training data at scale
- Track your scraping usage and account activity to optimize API consumption
Example prompts
Use the following example prompts to invoke Scrape.do MCP connector tools from your AI assistant or Boomi Connect workflow:
Scrape the current pricing from our top five competitor websites and compare them to our rates.Create a job to monitor Google search results for our brand name across 10 different countries.Extract all product listings from an e-commerce site and structure them for our database.Check my Scrape.do account to see how many requests I have left this month.Scrape a real estate website and get details for all properties listed in a specific city.Set up automatic daily scraping of news articles related to our industry.Get the status of my large scraping job that I started two hours ago.Scrape a JavaScript-heavy website that requires rendering before data appears.Monitor social media competitor profiles and collect their latest posts.Extract contact information and job titles from a professional networking site.
Scrape.do MCP connector tools
The Scrape.do MCP connector provides the following tools. Each tool maps to a specific action you can invoke from your AI agent or automation.
| Tool | Description |
|---|---|
| scrapedo_scrapedoscrapewebsite_invoke | Extracts content and data from a website immediately and returns the results. |
| createJob | Starts an asynchronous scraping task that runs in the background. |
| getJob | Retrieves the current status and results of a previously created scraping task. |
| getMe | Returns your account information and current usage statistics. |