browser-automation

Hyperbrowser

hyperbrowserai

by hyperbrowserai

Hyperbrowser enables web scraping, internet scraping, and automation to scrape any website for data extraction or web cr

Enables web browsing capabilities through tools for content extraction, link following, and browser automation with customizable parameters for scraping, data collection, and web crawling tasks.

github stars

742

0 commentsdiscussion

Both formats append explainx.ai attribution and the canonical URL for this MCP server listing.

Requires Hyperbrowser API keyIntegrates multiple browser agentsSupports structured data extraction

best for

  • / Data scientists collecting web data
  • / Developers building web scrapers
  • / Researchers gathering online information
  • / Automation workflows requiring web interaction

capabilities

  • / Scrape webpage content and extract data
  • / Crawl websites and follow links
  • / Extract structured data from web pages
  • / Access browser agents for automation
  • / Perform custom web scraping with parameters
  • / Collect data from multiple web sources

what it does

Connects to Hyperbrowser's API for web scraping, data extraction, and browser automation. Provides access to browser agents like OpenAI's CUA and Anthropic's Claude Computer Use.

about

Hyperbrowser is an official MCP server published by hyperbrowserai that provides AI assistants with tools and capabilities via the Model Context Protocol. Hyperbrowser enables web scraping, internet scraping, and automation to scrape any website for data extraction or web cr It is categorized under browser automation.

how to install

You can install Hyperbrowser in your AI client of choice. Use the install panel on this page to get one-click setup for Cursor, Claude Desktop, VS Code, and other MCP-compatible clients. This server runs locally on your machine via the stdio transport.

license

MIT

Hyperbrowser is released under the MIT license. This is a permissive open-source license, meaning you can freely use, modify, and distribute the software.

readme

Hyperbrowser MCP Server

smithery badge

Frame 5

This is Hyperbrowser's Model Context Protocol (MCP) Server. It provides various tools to scrape, extract structured data, and crawl webpages. It also provides easy access to general purpose browser agents like OpenAI's CUA, Anthropic's Claude Computer Use, and Browser Use.

More information about the Hyperbrowser can be found here. The hyperbrowser API supports a superset of features present in the mcp server.

More information about the Model Context Protocol can be found here.

Table of Contents

Installation

Manual Installation

To install the server, run:

npx hyperbrowser-mcp <YOUR-HYPERBROWSER-API-KEY>

Running on Cursor

Add to ~/.cursor/mcp.json like this:

{
  "mcpServers": {
    "hyperbrowser": {
      "command": "npx",
      "args": ["-y", "hyperbrowser-mcp"],
      "env": {
        "HYPERBROWSER_API_KEY": "YOUR-API-KEY"
      }
    }
  }
}

Running on Windsurf

Add to your ./codeium/windsurf/model_config.json like this:

{
  "mcpServers": {
    "hyperbrowser": {
      "command": "npx",
      "args": ["-y", "hyperbrowser-mcp"],
      "env": {
        "HYPERBROWSER_API_KEY": "YOUR-API-KEY"
      }
    }
  }
}

Development

For development purposes, you can run the server directly from the source code.

  1. Clone the repository:

    git clone [email protected]:hyperbrowserai/mcp.git hyperbrowser-mcp
    cd hyperbrowser-mcp
    
  2. Install dependencies:

    npm install # or yarn install
    npm run build
    
  3. Run the server:

    node dist/server.js
    

Claude Desktop app

This is an example config for the Hyperbrowser MCP server for the Claude Desktop client.

{
  "mcpServers": {
    "hyperbrowser": {
      "command": "npx",
      "args": ["--yes", "hyperbrowser-mcp"],
      "env": {
        "HYPERBROWSER_API_KEY": "your-api-key"
      }
    }
  }
}

Tools

  • scrape_webpage - Extract formatted (markdown, screenshot etc) content from any webpage
  • crawl_webpages - Navigate through multiple linked pages and extract LLM-friendly formatted content
  • extract_structured_data - Convert messy HTML into structured JSON
  • search_with_bing - Query the web and get results with Bing search
  • browser_use_agent - Fast, lightweight browser automation with the Browser Use agent
  • openai_computer_use_agent - General-purpose automation using OpenAI’s CUA model
  • claude_computer_use_agent - Complex browser tasks using Claude computer use
  • create_profile - Creates a new persistent Hyperbrowser profile.
  • delete_profile - Deletes an existing persistent Hyperbrowser profile.
  • list_profiles - Lists existing persistent Hyperbrowser profiles.

Installing via Smithery

To install Hyperbrowser MCP Server for Claude Desktop automatically via Smithery:

npx -y @smithery/cli install @hyperbrowserai/mcp --client claude

Resources

The server provides the documentation about hyperbrowser through the resources methods. Any client which can do discovery over resources has access to it.

License

This project is licensed under the MIT License.

FAQ

What is the Hyperbrowser MCP server?
Hyperbrowser is a Model Context Protocol (MCP) server profile on explainx.ai. MCP lets AI hosts (e.g. Claude Desktop, Cursor) call tools and resources through a standard interface; this page summarizes categories, install hints, and community ratings.
How do MCP servers relate to agent skills?
Skills are reusable instruction packages (often SKILL.md); MCP servers expose live capabilities. Teams frequently combine both—skills for workflows, MCP for APIs and data. See explainx.ai/skills and explainx.ai/mcp-servers for parallel directories.
How are reviews shown for Hyperbrowser?
This profile displays 66 aggregated ratings (sample rows for discoverability plus signed-in user reviews). Average score is about 4.7 out of 5—verify behavior in your own environment before production use.

Use Cases

Web Research & Information Gathering

Fetch and extract information from websites automatically

Example

Research competitor pricing, scrape product reviews, monitor news mentions

Automate 5-10 hours/week of manual web research

Content Monitoring & Alerts

Track website changes, new content, price updates

Example

Monitor competitor blog for new posts, track stock availability, watch for pricing changes

Stay informed without manual checking, never miss important updates

Data Extraction & Aggregation

Extract structured data from multiple websites

Example

Compile product listings from 10 e-commerce sites, aggregate job postings, collect real estate data

Build datasets 100x faster than manual copying

API-less Integration

Interact with services that don't offer APIs

Example

Check form submissions, validate website functionality, test user flows

Automate interactions with any website, even without API

Implementation Guide

Prerequisites

  • Claude Desktop or Cursor with MCP support
  • Understanding of web scraping ethics and robots.txt
  • Rate limiting awareness to avoid overwhelming target sites
  • Knowledge of legal restrictions on data collection

Time Estimate

20-40 minutes including configuration and testing

Installation Steps

  1. 1.Install web automation MCP server via npm or pip
  2. 2.Configure allowed domains and rate limits in MCP config
  3. 3.Test with simple fetch: 'Get content from example.com'
  4. 4.Progress to extraction: 'Extract all product prices from this page'
  5. 5.Set up monitoring: 'Check this URL daily for changes'
  6. 6.Parse structured data: 'Create CSV from this table'
  7. 7.Respect robots.txt and rate limits always

Troubleshooting

  • 403 Forbidden: Website blocks bots—respect their wishes, use official API instead
  • Rate limit errors: Slow down requests, add delays between fetches
  • Stale data: Target site changed HTML structure—update selectors
  • Timeout errors: Site is slow or blocking—increase timeout, try different user agent
  • JavaScript-rendered content: Use headless browser MCP servers for dynamic sites

Best Practices

✓ Do

  • +Check robots.txt and respect crawl rules
  • +Rate limit requests: 1-2 requests/second maximum
  • +Use official APIs when available instead of scraping
  • +Identify your bot with descriptive user agent
  • +Cache results to minimize repeated requests
  • +Handle errors gracefully with retries and fallbacks
  • +Validate extracted data for accuracy

✗ Don't

  • Don't scrape sites that explicitly forbid it (robots.txt, ToS)
  • Don't overwhelm servers with rapid requests—use rate limiting
  • Don't scrape personal data without consent and legal basis
  • Don't ignore copyright on extracted content
  • Don't assume HTML structure is stable—handle changes
  • Don't use scraped data for commercial purposes without permission

💡 Pro Tips

  • Use CSS selectors or XPath for robust data extraction
  • Set up monitoring alerts for extraction failures (structure changed)
  • Implement exponential backoff for retries on failures
  • Store raw HTML for reprocessing if extraction logic changes
  • Combine with data analysis tools for insights from extracted data
  • Consider using official APIs or RSS feeds as more stable alternatives

Technical Details

Architecture

MCP server handles HTTP requests, HTML parsing, JavaScript rendering (if headless browser), and returns structured data to Claude.

Protocols

  • HTTP/HTTPS
  • WebSocket (for real-time sites)
  • Puppeteer/Playwright (for JavaScript sites)

Compatibility

  • Static HTML sites
  • JavaScript-rendered SPAs (with headless browser)
  • REST APIs
  • GraphQL endpoints

When to Use This

✓ Use When

Use for research automation, content monitoring, data aggregation from multiple sources, and when official APIs don't exist. Best for read-only information gathering.

✗ Avoid When

Avoid for sites with APIs (use API instead), sites that explicitly forbid scraping, when data is copyrighted, or for login-required content without proper authorization.

Integration

  • Scheduled monitoring with change detection
  • Multi-source data aggregation pipelines
  • Fallback to web scraping when API rate limits hit
  • Headless browser for JavaScript-heavy sites

Discussion

Product Hunt–style comments (not star reviews)
  • No comments yet — start the thread.

List & Promote Your MCP Server

Share your MCP server with the developer community

GET_STARTED →
MCP server reviews

Ratings

4.766 reviews
  • Isabella Dixit· Dec 24, 2024

    Hyperbrowser is a well-scoped MCP server in the explainx.ai directory — install snippets and categories matched our Claude Code setup.

  • Isabella Ghosh· Dec 24, 2024

    Useful MCP listing: Hyperbrowser is the kind of server we cite when onboarding engineers to host + tool permissions.

  • Amina Desai· Dec 12, 2024

    I recommend Hyperbrowser for teams standardizing on MCP; the explainx.ai page compares cleanly with sibling servers.

  • Isabella Desai· Nov 15, 2024

    We wired Hyperbrowser into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.

  • Kofi Sharma· Nov 15, 2024

    I recommend Hyperbrowser for teams standardizing on MCP; the explainx.ai page compares cleanly with sibling servers.

  • Advait Nasser· Nov 15, 2024

    Hyperbrowser reduced integration guesswork — categories and install configs on the listing matched the upstream repo.

  • Chen White· Nov 11, 2024

    We wired Hyperbrowser into a staging workspace; the listing’s GitHub and npm pointers saved time versus hunting across READMEs.

  • Kofi Sethi· Nov 3, 2024

    Hyperbrowser is a well-scoped MCP server in the explainx.ai directory — install snippets and categories matched our Claude Code setup.

  • Arjun Wang· Oct 22, 2024

    Useful MCP listing: Hyperbrowser is the kind of server we cite when onboarding engineers to host + tool permissions.

  • Neel Haddad· Oct 6, 2024

    According to our notes, Hyperbrowser benefits from clear Model Context Protocol framing — fewer ambiguous “AI plugin” claims.

showing 1-10 of 66

1 / 7