trackmcp
Back to directory
zeeb0tt

web-scraping-api-mcp

View on GitHub
2 starsWeb & Internet Tools Updated May 29, 2025

Documentation

🚀 We’ve just launched our new MCP server!

If you're building or using AI agents, you can now plug our web scraping API directly into your autonomous workflows. Just add the following to your MCP config:

code
{
  "mcpServers": {
    "web-scraping-api-by-instantapi-ai": {
      "command": "npx",
      "args": [
        "-y",
        "mcp-remote",
        "https://web-scraping-api-by-instantapi-ai.help-052.workers.dev/sse",
        "--header",
        "Authorization:${AUTH_HEADER}"
      ],
      "env": {
        "AUTH_HEADER": "Bearer "
      }
    }
  }
}

🔐 Just replace with your API key from InstantAPI.ai. Sign up for your own API key here: https://web.instantapi.ai/#pricing-03-254921

Once connected, your AI agent can automatically invoke any of our scraping endpoints—/scrape, /links, /next, /search—to complete complex web data tasks, without needing any HTML selectors or manual logic.

🧠 Example real-world task from a user:

code
Go to https://www.domain.com.au/sale/bowral-nsw-2576/?bedrooms=1-any&bathrooms=1-any&excludeunderoffer=1&establishedtype=established&sort=dateupdated-desc
Extract each property link.
For each, get the full physical address and how many days since it was listed. If not known, assume 0 (today).
Keep paginating until no properties are listed in the last 7 days.
Return all matching addresses.

✅ The agent completed the task autonomously—scraping new leads for a mortgage broker with zero code written.

If you’re building AI workflows, this massively cuts down on glue code and edge case handling. Just give your agent a goal and let it fetch the data.

Frequently asked questions

What is web-scraping-api-mcp?

web-scraping-api-mcp is a Model Context Protocol (MCP) server listed in the TrackMCP directory.

How do I install web-scraping-api-mcp?

Open the GitHub repository and follow its README. Most MCP servers are added to your client's MCP config, then called by your agent.

Is web-scraping-api-mcp open source?

Yes — it is hosted on GitHub at https://github.com/zeeb0tt/web-scraping-api-mcp and has 2 stars.

Related MCP tools

executeautomationmcp-playwright

Playwright Model Context Protocol Server - Tool to automate Browsers and APIs in Claude Desktop, Cline, Cursor IDE and More 🔌

4,918 TypeScript
jae-jaefetcher-mcp

MCP server for fetch web page content using Playwright headless browser. TypeScript-based implementation. Trusted by 800+ developers.

898 TypeScript
aimcpplaywright
co-browserbrowser-use-mcp-server

Browse the web, directly from Cursor etc. Built for the Model Context Protocol to enhance AI capabilities. Python-based implementation.

760 Python
browserbrowser-usecursor+3
web-agent-mastergoogle-search

A Playwright-based Node.js tool that bypasses search engine anti-scraping mechanisms to execute Google searches. Built for the Model Context Protocol to...

483 TypeScript
aigoogle-searchllm+2
vercel-labsmcp-for-next.js

This sample app uses the Vercel MCP Adapter that allows you to drop in an MCP server on a group of routes in any Next.js project.

311 JavaScript
joreillyclimatetracekmp

Kotlin/Compose Multiplatform project to show climate related emission data from https://climatetrace.org/data. Built for the Model Context Protocol to enhance A

301 Kotlin
androidcomposecompose-desktop+13

Run your own MCP server? See who uses it and what to fix.

Measure it with TrackMCP