Scrape individual web pages and convert them to clean, LLM-ready markdown. Handles JavaScript rendering, anti-bot protection, and dynamic content.
Works with
AI-first code editor with Composer
Before installing skills in Cursor, ensure your development environment meets these requirements:
node --versionfirecrawl-scrapingExecute the skills CLI command in your project's root directory to begin installation:
Fetches firecrawl-scraping from casper-studios/casper-marketplace and configures it for Cursor.
The CLI shows a list of agents. Use arrow keys and space to select Cursor:
Confirm successful installation by checking the skill directory location:
Restart Cursor to activate firecrawl-scraping. Access via /firecrawl-scraping in your agent's command palette.
We perform automated surface-level scans (Gen AI Scanner, Socket, Snyk) during installation. These checks detect common vulnerabilities but do not guarantee complete security. Always review skill source code and verify the publisher's reputation before production use.
Skills execute code in your environment. Always review source, verify the publisher, and test in isolation before production.
Submit your Claude Code skill and start earning
Automate repetitive workflows and reduce manual effort
Example
Generate reports, summarize documents, draft communications
Save 3-5 hours per week on routine tasks
Learn new skills, understand complex topics, get expert guidance
Example
Explain concepts, provide examples, suggest learning resources
Accelerate learning and skill development by 2x
Enhance output quality through reviews, suggestions, and refinements
Example
Review drafts, suggest improvements, catch errors
Improve work quality by 30-40% with less effort
0
total installs
0
this week
10
GitHub stars
0
upvotes
Run in your terminal
0
installs
0
this week
10
stars
Scrape individual web pages and convert them to clean, LLM-ready markdown. Handles JavaScript rendering, anti-bot protection, and dynamic content.
What are you scraping?
│
├── Single page (article, blog, docs)
│ └── references/single-page.md
│ └── Script: scripts/firecrawl_scrape.py
│
└── Entire website (multiple pages, crawling)
└── references/website-crawler.md
└── (Use Apify Website Content Crawler for multi-page)
# Required in .env
FIRECRAWL_API_KEY=fc-your-api-key-here
Get your API key: https://firecrawl.dev/app/api-keys
python scripts/firecrawl_scrape.py "https://example.com/article"
python scripts/firecrawl_scrape.py "https://wsj.com/article" \
--proxy stealth \
--format markdown summary \
--timeout 60000
| Mode | Use Case |
|---|---|
basic |
Standard sites, fastest |
stealth |
Anti-bot protection, premium content (WSJ, NYT) |
auto |
Let Firecrawl decide (recommended) |
markdown - Clean markdown content (default)html - Raw HTMLsummary - AI-generated summaryscreenshot - Page screenshotlinks - All links on page~1 credit per page. Stealth proxy may use additional credits.
FIRECRAWL_API_KEY in .env file (never commit to git).tmp/ directorySymptoms: API returns "insufficient credits" or quota exceeded error Cause: Account credits depleted Solution:
basic proxy mode to conserve creditsSymptoms: Empty content or partial HTML returned Cause: JavaScript-heavy page not fully loading Solution:
--js-render flag--timeout 60000 (60 seconds)stealth proxy mode for protected sites--wait-for selectorSymptoms: Script returns 403 status code Cause: Site blocking automated access Solution:
stealth proxy modeSymptoms: Scrape succeeds but markdown is empty or malformed Cause: Dynamic content loaded after page load, or unusual page structure Solution:
--wait-for to wait for specific contenthtml format to see raw contentSymptoms: Request times out before completion Cause: Slow page load or large page content Solution:
basic proxy for faster responseSkills: firecrawl-scraping → parallel-research Use case: Scrape competitor pages, then analyze content strategy Flow:
Skills: firecrawl-scraping → content-generation Use case: Create summary documents from web research Flow:
Skills: firecrawl-scraping → attio-crm Use case: Enrich company records with website data Flow:
Prerequisites
Time Estimate
15-45 minutes depending on use case complexity
Steps
Common Pitfalls
✓ Do
✗ Don't
💡 Pro Tips
✓ Use when
Use when skill capabilities match your task, clear ROI on time saved, and you can validate outputs. Best for repetitive tasks, learning, and quality improvement.
✗ Avoid when
Avoid when task requires deep expertise you can't validate, involves sensitive decisions, or when learning process is more valuable than speed of completion.
jwynia/agent-skills
mindrally/skills
github/awesome-copilot
kostja94/marketing-skills
wispbit-ai/skills
shubhamsaboo/awesome-llm-apps
Useful defaults in firecrawl-scraping — fewer surprises than typical one-off scripts, and it plays nicely with `npx skills` flows.
We added firecrawl-scraping from the explainx registry; install was straightforward and the SKILL.md answered most questions upfront.
Keeps context tight: firecrawl-scraping is the kind of skill you can hand to a new teammate without a long onboarding doc.
I recommend firecrawl-scraping for anyone iterating fast on agent tooling; clear intent and a small, reviewable surface area.
firecrawl-scraping is among the better-maintained entries we tried; worth keeping pinned for repeat workflows.
Useful defaults in firecrawl-scraping — fewer surprises than typical one-off scripts, and it plays nicely with `npx skills` flows.
Solid pick for teams standardizing on skills: firecrawl-scraping is focused, and the summary matches what you get after install.
firecrawl-scraping is among the better-maintained entries we tried; worth keeping pinned for repeat workflows.
firecrawl-scraping fits our agent workflows well — practical, well scoped, and easy to wire into existing repos.
firecrawl-scraping has been reliable in day-to-day use. Documentation quality is above average for community skills.
showing 1-10 of 58