GetWeb offers reliable web scraping and content extraction. Scrape any website with advanced internet scraping and filte
by ivan-mezentsev·Updated Apr 13, 2026Fetch and extract information from websites automatically
Example: Research competitor pricing, scrape product reviews, monitor news mentions
Automate 5-10 hours/week of manual web research
Track website changes, new content, price updates
Example: Monitor competitor blog for new posts, track stock availability, watch for pricing changes
Stay informed without manual checking, never miss important updates
Extract structured data from multiple websites
Example: Compile product listings from 10 e-commerce sites, aggregate job postings, collect real estate data
Build datasets 100x faster than manual copying
Interact with services that don't offer APIs
Example: Check form submissions, validate website functionality, test user flows
Automate interactions with any website, even without API
YouTube Transcripts
Extract and analyze YouTube transcripts in multiple languages. Use our YouTube transcriptor to easily transcribe for You
Web Reader
Web Reader MCP Server — Z.AI MCP for powerful web content extraction: full-page retrieval and structured data for Claude
Web Research
Research any topic fast with Web Research – powerful web scraping tools and advanced Google dorking for results you can
mcp-server-rag-web-browser
MCP server implementing the RAG Web Browser Actor — a web browsing/search tool for LLMs and RAG pipelines, enabling web-
WebScraping.AI
WebScraping.AI offers robust web scraping with proxy support, JavaScript rendering, and structured data extraction to sc
Strong directory entry: GetWeb surfaces stars and publisher context so we could sanity-check maintenance before adopting.
According to our notes, GetWeb benefits from clear Model Context Protocol framing — fewer ambiguous “AI plugin” claims.
We evaluated GetWeb against two servers with overlapping tools; this profile had the clearer scope statement.
GetWeb is among the better-indexed MCP projects we tried; the explainx.ai summary tracks the official description.
We wired GetWeb into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.
GetWeb is among the better-indexed MCP projects we tried; the explainx.ai summary tracks the official description.
GetWeb has been reliable for tool-calling workflows; the MCP profile page is a good permalink for internal docs.
Strong directory entry: GetWeb surfaces stars and publisher context so we could sanity-check maintenance before adopting.
GetWeb reduced integration guesswork — categories and install configs on the listing matched the upstream repo.
GetWeb is a well-scoped MCP server in the explainx.ai directory — install snippets and categories matched our Claude Code setup.
showing 1-10 of 48
Share your MCP server with the developer community
Select a client to integrate this server.
Claude Desktop configuration
{
"mcpServers": {
"getweb": {
"command": "npx",
"args": [
"mcp-getweb"
],
"env": {
"GOOGLE_API_KEY": "XXXXXXXXX",
"GOOGLE_SEARCH_ENGINE_ID": "XXXXXXXXX",
"JINA_API_KEY": "jina_XXXXXXXXX"
}
}
}
}Searches the web using multiple search engines (DuckDuckGo, Google, Felo AI) and extracts/converts web content to markdown format. Includes caching and user agent rotation for reliable web scraping.
GetWeb is a community-built MCP server published by ivan-mezentsev that provides AI assistants with tools and capabilities via the Model Context Protocol. GetWeb offers reliable web scraping and content extraction. Scrape any website with advanced internet scraping and filte It is categorized under search web.
You can install GetWeb in your AI client of choice. Use the install panel on this page to get one-click setup for Cursor, Claude Desktop, VS Code, and other MCP-compatible clients. This server runs locally on your machine via the stdio transport.
A Model Context Protocol (MCP) server that provides web search and content extraction capabilities.
{
"mcpServers": {
"getweb": {
"command": "npx",
"args": [
"mcp-getweb"
],
"type": "stdio",
"env": {
"GOOGLE_API_KEY": "XXXXXXXXX",
"GOOGLE_SEARCH_ENGINE_ID": "XXXXXXXXX",
"JINA_API_KEY": "jina_XXXXXXXXX",
"LINKUP_API_KEY": "XXXXXXXXX",
"EXA_API_KEY": "XXXXXXXXX"
}
}
}
}
duckduckgo-search)Search the web using DuckDuckGo with HTML scraping.
Parameters:
query (string, required): The search querypage (integer, optional): Page number (default: 1, min: 1)numResults (integer, optional): Number of results to return (default: 10, min: 1, max: 20)google-search)Search Google and return relevant results using the Programmable Search Engine.
Parameters:
query (string, required): Search query; quotes enable exact matchesnum_results (integer, optional): Total results to return (default: 5, max: 10)site (string, optional): Restrict to a specific site/domain (e.g., wikipedia.org)language (string, optional): ISO 639-1 language code (e.g., en, es)dateRestrict (string, optional): Date filter, e.g., d7, w4, m6, y1exactTerms (string, optional): Exact phrase that must appearresultType (string, optional): Result type: image|images|news|video|videospage (integer, optional): Page number for pagination (default: 1, min: 1)resultsPerPage (integer, optional): Results per page (default: 5, max: 10)sort (string, optional): Sort order, relevance (default) or dateNote: Requires GOOGLE_API_KEY and GOOGLE_SEARCH_ENGINE_ID to be set.
linkup_search)Search the web via Linkup API and return relevant results in Markdown.
Parameters:
query (string, required): Natural-language search queryonlySearchTheseDomains (array of strings, optional): Restrict results to specific domainsdateFilter (object, optional): Date range filter
fromDate (string, optional): Start date in YYYY-MM-DDtoDate (string, optional): End date in YYYY-MM-DDmaxResults (integer, optional): Maximum number of results to return (default: 5, min: 1)Note: Requires LINKUP_API_KEY to be set.
exa_search)Search the web via Exa API and return relevant results in Markdown.
Parameters:
query (string, required): Natural-language search querymaxResults (integer, optional): Number of results to return (default: 10, max: 25)publishedDateRange (object, optional): Published date range filter
fromDate (string, optional): Start date, RFC3339 (e.g., 2024-02-09T00:00:00.000Z) or YYYY-MM-DDtoDate (string, optional): End date, RFC3339 (e.g., 2024-02-09T00:00:00.000Z) or YYYY-MM-DDcrawlDateRange (object, optional): Crawl date range filter
fromDate (string, optional): Start date, RFC3339 or YYYY-MM-DDtoDate (string, optional): End date, RFC3339 or YYYY-MM-DDuserLocation (string, optional): Two-letter ISO country code (e.g., US)includeText (string, optional): Exact phrase that must appear in the webpage text (max 5 words)excludeText (string, optional): Exact phrase that must not appear in the webpage text (max 5 words)domain (string, optional): Restrict results to a single domain (e.g., arxiv.org)Note: Requires EXA_API_KEY to be set.
felo-search)AI-powered search with contextual responses for up-to-date technical information (releases, advisories, migrations, benchmarks, community insights).
Parameters:
query (string, required): The search query or promptstream (boolean, optional): Whether to stream the response (default: false)fetch-url)Fetch the clean content of a URL and return it as text.
Parameters:
url (string, required): The URL to fetchmaxLength (integer, optional): Maximum content length (default: 30000, min: 1000, max: 500000)extractMainContent (boolean, optional): Attempt to extract main content when HTML (default: true)url-metadata)Extract metadata (title, description, image, favicon) from a URL.
Parameters:
url (string, required): The URL to extract metadata fromurl-fetch)Fetch web pages and convert them to Markdown. Handles HTML, plaintext, and JSON (pretty-printed in a fenced block).
Parameters:
url (string, required): The URL to fetch and convert to Markdownjina-reader)Retrieve LLM-friendly content from a URL using Jina r.reader with optional summaries and formats.
Parameters:
url (string, required): The URL to fetch and parsemaxLength (integer, optional): Maximum output length (default: 10000, min: 1000, max: 50000)withLinksummary (boolean, optional): Include links summary (default: false)withImagesSummary (boolean, optional): Include images summary (default: false)withGeneratedAlt (boolean, optional): Generate alt text for images (default: false)returnFormat (string, optional): markdown (default) | html | text | screenshot | pageshotnoCache (boolean, optional): Bypass cache (default: false)timeout (integer, optional): Max seconds to wait (default: 10, min: 5, max: 30)Note: Requires JINA_API_KEY to be set.
If you encounter any issues or have questions, please open an issue on GitHub.
Time estimate: 20-40 minutes including configuration and testing
Prerequisites
Steps
Troubleshooting
✓ Do
✗ Don't
💡 Pro Tips
Architecture
MCP server handles HTTP requests, HTML parsing, JavaScript rendering (if headless browser), and returns structured data to Claude.
Protocols
Compatibility
✓ Use when
Use for research automation, content monitoring, data aggregation from multiple sources, and when official APIs don't exist. Best for read-only information gathering.
✗ Avoid when
Avoid for sites with APIs (use API instead), sites that explicitly forbid scraping, when data is copyrighted, or for login-required content without proper authorization.