crawl-websites-at-scale

SKILLWorkflowcommunity
v0.0.0besoeasyMITUpdated 3mo agoSource →

Scrape websites at scale using Scrapy, a Python web crawling and scraping framework. Use when: (1) Crawling multiple pages or entire sites, (2) Extracting structured data from HTML/XML, or (3) Building automated data pipelines from web sources.

Community-submitted skill. Not yet reviewed by the Forge team. Full prompt content may not be available.Request review →
130Repo stars
1Clients
1Formats
3mo agoLast update
Skill
Authorbesoeasy
Version0.0.0
LicenseMIT
CategoryWorkflow
Formatsskill.md
PromptNot published
Compatibility
Claude✓ Supported
Cursor
Copilot
ChatGPT
Gemini
About

Scrape websites at scale using Scrapy, a Python web crawling and scraping framework. Use when: (1) Crawling multiple pages or entire sites, (2) Extracting structured data from HTML/XML, or (3) Building automated data pipelines from web sources.

Keywords
skillclaude