by ivan-mezentsev
GetWeb offers reliable web scraping and content extraction. Scrape any website with advanced internet scraping and filte
Searches the web using multiple search engines (DuckDuckGo, Google, Felo AI) and extracts/converts web content to markdown format. Includes caching and user agent rotation for reliable web scraping.
GetWeb is a community-built MCP server published by ivan-mezentsev that provides AI assistants with tools and capabilities via the Model Context Protocol. GetWeb offers reliable web scraping and content extraction. Scrape any website with advanced internet scraping and filte It is categorized under search web.
You can install GetWeb in your AI client of choice. Use the install panel on this page to get one-click setup for Cursor, Claude Desktop, VS Code, and other MCP-compatible clients. This server runs locally on your machine via the stdio transport.
MIT
GetWeb is released under the MIT license. This is a permissive open-source license, meaning you can freely use, modify, and distribute the software.
Fetch and extract information from websites automatically
Example
Research competitor pricing, scrape product reviews, monitor news mentions
Automate 5-10 hours/week of manual web research
Track website changes, new content, price updates
Example
Monitor competitor blog for new posts, track stock availability, watch for pricing changes
Stay informed without manual checking, never miss important updates
Extract structured data from multiple websites
Example
Compile product listings from 10 e-commerce sites, aggregate job postings, collect real estate data
Build datasets 100x faster than manual copying
Share your MCP server with the developer community
Strong directory entry: GetWeb surfaces stars and publisher context so we could sanity-check maintenance before adopting.
According to our notes, GetWeb benefits from clear Model Context Protocol framing — fewer ambiguous “AI plugin” claims.
We evaluated GetWeb against two servers with overlapping tools; this profile had the clearer scope statement.
GetWeb is among the better-indexed MCP projects we tried; the explainx.ai summary tracks the official description.
We wired GetWeb into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.
GetWeb is among the better-indexed MCP projects we tried; the explainx.ai summary tracks the official description.
GetWeb has been reliable for tool-calling workflows; the MCP profile page is a good permalink for internal docs.
Strong directory entry: GetWeb surfaces stars and publisher context so we could sanity-check maintenance before adopting.
GetWeb reduced integration guesswork — categories and install configs on the listing matched the upstream repo.
GetWeb is a well-scoped MCP server in the explainx.ai directory — install snippets and categories matched our Claude Code setup.
showing 1-10 of 48
A Model Context Protocol (MCP) server that provides web search and content extraction capabilities.
{
"mcpServers": {
"getweb": {
"command": "npx",
"args": [
"mcp-getweb"
],
"type": "stdio",
"env": {
"GOOGLE_API_KEY": "XXXXXXXXX",
"GOOGLE_SEARCH_ENGINE_ID": "XXXXXXXXX",
"JINA_API_KEY": "jina_XXXXXXXXX",
"LINKUP_API_KEY": "XXXXXXXXX",
"EXA_API_KEY": "XXXXXXXXX"
}
}
}
}
duckduckgo-search)Search the web using DuckDuckGo with HTML scraping.
Parameters:
query (string, required): The search querypage (integer, optional): Page number (default: 1, min: 1)numResults (integer, optional): Number of results to return (default: 10, min: 1, max: 20)google-search)Search Google and return relevant results using the Programmable Search Engine.
Parameters:
query (string, required): Search query; quotes enable exact matchesnum_results (integer, optional): Total results to return (default: 5, max: 10)site (string, optional): Restrict to a specific site/domain (e.g., wikipedia.org)language (string, optional): ISO 639-1 language code (e.g., en, es)dateRestrict (string, optional): Date filter, e.g., d7, w4, m6, y1exactTerms (string, optional): Exact phrase that must appearresultType (string, optional): Result type: image|images|news|video|videospage (integer, optional): Page number for pagination (default: 1, min: 1)resultsPerPage (integer, optional): Results per page (default: 5, max: 10)sort (string, optional): Sort order, relevance (default) or dateNote: Requires GOOGLE_API_KEY and GOOGLE_SEARCH_ENGINE_ID to be set.
linkup_search)Search the web via Linkup API and return relevant results in Markdown.
Parameters:
query (string, required): Natural-language search queryonlySearchTheseDomains (array of strings, optional): Restrict results to specific domainsdateFilter (object, optional): Date range filter
fromDate (string, optional): Start date in YYYY-MM-DDtoDate (string, optional): End date in YYYY-MM-DDmaxResults (integer, optional): Maximum number of results to return (default: 5, min: 1)Note: Requires LINKUP_API_KEY to be set.
exa_search)Search the web via Exa API and return relevant results in Markdown.
Parameters:
query (string, required): Natural-language search querymaxResults (integer, optional): Number of results to return (default: 10, max: 25)publishedDateRange (object, optional): Published date range filter
fromDate (string, optional): Start date, RFC3339 (e.g., 2024-02-09T00:00:00.000Z) or YYYY-MM-DDtoDate (string, optional): End date, RFC3339 (e.g., 2024-02-09T00:00:00.000Z) or YYYY-MM-DDcrawlDateRange (object, optional): Crawl date range filter
fromDate (string, optional): Start date, RFC3339 or YYYY-MM-DDtoDate (string, optional): End date, RFC3339 or YYYY-MM-DDuserLocation (string, optional): Two-letter ISO country code (e.g., US)includeText (string, optional): Exact phrase that must appear in the webpage text (max 5 words)excludeText (string, optional): Exact phrase that must not appear in the webpage text (max 5 words)domain (string, optional): Restrict results to a single domain (e.g., arxiv.org)Note: Requires EXA_API_KEY to be set.
felo-search)AI-powered search with contextual responses for up-to-date technical information (releases, advisories, migrations, benchmarks, community insights).
Parameters:
query (string, required): The search query or promptstream (boolean, optional): Whether to stream the response (default: false)fetch-url)Fetch the clean content of a URL and return it as text.
Parameters:
url (string, required): The URL to fetchmaxLength (integer, optional): Maximum content length (default: 30000, min: 1000, max: 500000)extractMainContent (boolean, optional): Attempt to extract main content when HTML (default: true)url-metadata)Extract metadata (title, description, image, favicon) from a URL.
Parameters:
url (string, required): The URL to extract metadata fromurl-fetch)Fetch web pages and convert them to Markdown. Handles HTML, plaintext, and JSON (pretty-printed in a fenced block).
Parameters:
url (string, required): The URL to fetch and convert to Markdownjina-reader)Retrieve LLM-friendly content from a URL using Jina r.reader with optional summaries and formats.
Parameters:
url (string, required): The URL to fetch and parsemaxLength (integer, optional): Maximum output length (default: 10000, min: 1000, max: 50000)withLinksummary (boolean, optional): Include links summary (default: false)withImagesSummary (boolean, optional): Include images summary (default: false)withGeneratedAlt (boolean, optional): Generate alt text for images (default: false)returnFormat (string, optional): markdown (default) | html | text | screenshot | pageshotnoCache (boolean, optional): Bypass cache (default: false)timeout (integer, optional): Max seconds to wait (default: 10, min: 5, max: 30)Note: Requires JINA_API_KEY to be set.
If you encounter any issues or have questions, please open an issue on GitHub.
Interact with services that don't offer APIs
Example
Check form submissions, validate website functionality, test user flows
Automate interactions with any website, even without API
Prerequisites
Time Estimate
20-40 minutes including configuration and testing
Steps
Troubleshooting
✓ Do
✗ Don't
💡 Pro Tips
Architecture
MCP server handles HTTP requests, HTML parsing, JavaScript rendering (if headless browser), and returns structured data to Claude.
Protocols
Compatibility
✓ Use when
Use for research automation, content monitoring, data aggregation from multiple sources, and when official APIs don't exist. Best for read-only information gathering.
✗ Avoid when
Avoid for sites with APIs (use API instead), sites that explicitly forbid scraping, when data is copyrighted, or for login-required content without proper authorization.