browser-automationsearch-web

Bright Data▌

by brightdata

Access real-time web scraping with Bright Data. Scrape any website and extract structured data easily using advanced web

Integrates with Bright Data's web scraping infrastructure to provide real-time access to public web data through specialized tools for search engine scraping, webpage extraction, and structured data retrieval from popular websites.

github stars

★ 2.2K

GitHub Website npm

5,000 requests/month free tierAnti-blocking infrastructureReal-time data access

best for

/ AI applications needing live web data
/ Market research and competitive analysis
/ Content aggregation and monitoring
/ Building AI agents with web access

capabilities

/ Scrape Google search results
/ Extract data from any webpage
/ Retrieve structured data from popular websites
/ Access real-time web content
/ Bypass anti-scraping protections
/ Search engine results extraction

what it does

Provides real-time web scraping capabilities through Bright Data's infrastructure, allowing AI to extract data from websites without getting blocked.

about

Bright Data is an official MCP server published by brightdata that provides AI assistants with tools and capabilities via the Model Context Protocol. Access real-time web scraping with Bright Data. Scrape any website and extract structured data easily using advanced web It is categorized under browser automation, search web.

how to install

You can install Bright Data in your AI client of choice. Use the install panel on this page to get one-click setup for Cursor, Claude Desktop, VS Code, and other MCP-compatible clients. This server runs locally on your machine via the stdio transport.

license

MIT

Bright Data is released under the MIT license. This is a permissive open-source license, meaning you can freely use, modify, and distribute the software.

readme

The Web MCP

🌐 Give your AI real-time web superpowers
Seamlessly connect LLMs to the live web without getting blocked

Quick Start • Features • Pricing • Demos • Docs • Support

🎉 Free Tier Available! 🎉

5,000 requests/month FREE
_{Perfect for prototyping and everyday AI workflows}

🚀 Launch Week - January 2026 🚀

5 Days of Major Releases!

📦 Tool Groups

🧙 Setup Wizard

⚡ Token Efficiency

🏢 Enterprise Integrations

📊 Observability

--- ## 🌟 Overview **The Web MCP** is your gateway to giving AI assistants true web capabilities. No more outdated responses, no more "I can't access real-time information" - just seamless, reliable web access that actually works. Built by [Bright Data](https://brightdata.com), the world's #1 web data platform, this MCP server ensures your AI never gets blocked, rate-limited, or served CAPTCHAs.

✅ Works with Any LLM
_{Claude, GPT, Gemini, Llama}

🛡️ Never Gets Blocked
_{Enterprise-grade unblocking}

🚀 5,000 Free Requests
_Monthly

⚡ Zero Config
_{Works out of the box}

--- ## 🎯 Perfect For - 🔍 **Real-time Research** - Get current prices, news, and live data - 🛍️ **E-commerce Intelligence** - Monitor products, prices, and availability - 📊 **Market Analysis** - Track competitors and industry trends - 🤖 **AI Agents** - Build agents that can actually browse the web - 📝 **Content Creation** - Access up-to-date information for writing - 🎓 **Academic Research** - Gather data from multiple sources efficiently --- ## ⚡ Quick Start **Use the configuration wizard:** ![GIF for day2](https://github.com/user-attachments/assets/b3917553-6cf9-4264-bc7a-9b8b74df0a17)

📡 Use our hosted server - No installation needed!

Perfect for users who want zero setup. Just add this URL to your MCP client: ``` https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN_HERE ``` **Setup in Claude Desktop:** 1. Go to: Settings → Connectors → Add custom connector 2. Name: `Bright Data Web` 3. URL: `https://mcp.brightdata.com/mcp?token=YOUR_API_TOKEN` 4. Click "Add" and you're done! ✨

Run locally on your machine

```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "" } } } } ``` --- ## 🚀 Pricing & Modes

⚡ Rapid Mode (Free tier) 💎 Pro Mode 🔧 Custom Mode

$0/month

5,000 requests

✅ Web Search
✅ Scraping with Web unlocker
❌ Browser Automation
❌ Web data tools

Default Mode

Pay-as-you-go

Everything in rapid plus 60+ tools

✅ Browser Control
✅ Web Data APIs

PRO_MODE=true

Usage-based

Pick the tools you need

✅ Combine tool groups
✅ Add individual tools
❌ Overrides Pro eligibility

GROUPS="browser"
TOOLS="scrape_as_html"

> **💡 Note:** Pro mode is **not included** in the free tier and incurs > additional charges based on usage. --- ## 🧠 Advanced Tool Selection - `GROUPS` lets you enable curated tool bundles. Use comma-separated group IDs such as `ecommerce,browser`. - `TOOLS` adds explicit tool names on top of the selected groups. - Mode priority: `PRO_MODE=true` (all tools) → `GROUPS` / `TOOLS` (whitelist) → default rapid mode (base toolkit). - Base tools always enabled: `search_engine`, `search_engine_batch`, `scrape_as_markdown`, `scrape_batch`. - Group ID `custom` is reserved; use `TOOLS` for bespoke picks.

Group ID	Description	Featured tools
`ecommerce`	Retail and marketplace datasets	`web_data_amazon_product`, `web_data_walmart_product`, `web_data_google_shopping`
`social`	Social, community, and creator insights	`web_data_linkedin_posts`, `web_data_tiktok_posts`, `web_data_youtube_videos`
`browser`	Bright Data Scraping Browser automation tools	`scraping_browser_snapshot`, `scraping_browser_click_ref`, `scraping_browser_screenshot`
`finance`	Financial intelligence datasets	`web_data_yahoo_finance_business`
`business`	Company and location intelligence datasets	`web_data_crunchbase_company`, `web_data_zoominfo_company_profile`, `web_data_zillow_properties_listing`
`research`	News and developer data feeds	`web_data_github_repository_file`, `web_data_reuter_news`
`app_stores`	App store data	`web_data_google_play_store`, `web_data_apple_app_store`
`travel`	Travel information	`web_data_booking_hotel_listings`
`advanced_scraping`	Batch and AI-assisted extraction helpers	`search_engine_batch`, `scrape_batch`, `extract`

### Claude Desktop example ```json { "mcpServers": { "Bright Data": { "command": "npx", "args": ["@brightdata/mcp"], "env": { "API_TOKEN": "", "GROUPS": "browser,advanced_scraping", "TOOLS": "extract" } } } } ``` --- ## ✨ Features ### 🔥 Core Capabilities

🔍 Smart Web Search Google-quality results optimized for AI	📄 Clean Markdown AI-ready content extraction
🌍 Global Access Bypass geo-restrictions automatically	🛡️ Anti-Bot Protection Never get blocked or rate-limited
🤖 Browser Automation Control real browsers remotely (Pro)	⚡ Lightning Fast Optimized for minimal latency

### 🎯 Example Queries That Just Work ```yaml ✅ "What's Tesla's current stock price?" ✅ "Find the best-rated restaurants in Tokyo right now" ✅ "Get today's weather forecast for New York" ✅ "What movies are releasing this week?" ✅ "What are the trending topics on Twitter today?" ``` --- ## 🎬 Demos > **Note:** These videos show earlier versions. New demos coming soon! 🎥

View Demo Videos

### Basic Web Search Demo https://github.com/user-attachments/assets/59f6ebba-801a-49ab-8278-1b2120912e33 ### Advanced Scraping Demo https://github.com/user-attachments/assets/61ab0bee-fdfa-4d50-b0de-5fab96b4b91d [📺 More tutorials on YouTube →](https://github.com/brightdata-com/brightdata-mcp/blob/main/examples/README.md)

--- ## 🔧 Available Tools ### ⚡ Rapid Mode Tools (Default - Free) | Tool | Description | Use ---