WebScraping.AI MCP connector
WebScraping.AI is a web scraping automation API that renders JavaScript with Chrome, rotates proxies, and parses HTML from any website. The WebScraping.AI MCP connector allows AI agents to retrieve full page HTML by URL, extract specific page sections using CSS selectors, and check account quota usage. It also supports extracting multiple areas from a single page in one request to build structured data from web content.
Authentication type
- API Key - Requires a static API key to be configured before the agent can connect to the service.
Uses
Use the WebScraping.AI MCP connector to perform the following actions:
- Extract product prices and availability from competitor websites automatically
- Monitor job listings across multiple career sites and capture new openings daily
- Gather real estate property details, pricing, and market data from listing portals
- Collect news articles, headlines, and content from industry publications for analysis
- Scrape customer reviews and ratings from e-commerce platforms to track sentiment
- Extract financial data, earnings reports, and stock information from financial websites
- Capture event details, dates, and registration links from event listing websites
Example prompts
Use the following example prompts to invoke WebScraping.AI MCP connector tools from your AI assistant or Boomi Connect workflow:
Use WebScraping.AI to check my remaining API calls quota.Scrape the HTML from our competitor's pricing page using WebScraping.AI.Extract all product names and prices from the featured section of a retail website.Get the job titles and company names from a careers page using WebScraping.AI.Pull all customer review text and ratings from an e-commerce product page.Capture the main content area of a news article using WebScraping.AI.Retrieve multiple data points like price, availability, and description from a product page.Monitor a real estate listing site and extract property addresses and selling prices.Use WebScraping.AI to grab the header and product details sections from a website.Extract event names, dates, and registration links from a conference website.
WebScraping.AI MCP connector tools
The WebScraping.AI MCP connector provides the following tools. Each tool maps to a specific action you can invoke from your AI agent or automation.
| Tool | Description |
|---|---|
| account | Displays your current quota usage and remaining calls available. |
| getHTML | Retrieves the complete HTML content of a webpage from a given URL. |
| getSelected | Extracts HTML content from a specific area of a webpage using a CSS selector. |
| getSelectedMultiple | Extracts HTML content from multiple areas of a webpage using multiple CSS selectors. |