scraper-dev
NewAutomated scraper generation for data collection pipelines with support for HTTP/REST APIs, website parsing, FTP/SFTP, and email attachments. Generates type-safe, mypy and ruff compliant code with automatic quality checking. Features tabbed question interface for better UX. Includes version tracking, scraper maintenance tools (/fix-scraper, /update-scraper), self-contained Kafka notification support, and optional config file pre-configuration.
Install & Usage
mkdir -p .claude/skillsmkdir -p .claude/skills && curl -o .claude/skills/scraper-dev.md https://raw.githubusercontent.com/MarkEnverus/claude-scraper-agent/main/SKILL.md/scraper-devFrequently Asked Questions
What is scraper-dev?
Automated scraper generation for data collection pipelines with support for HTTP/REST APIs, website parsing, FTP/SFTP, and email attachments. Generates type-safe, mypy and ruff compliant code with automatic quality checking. Features tabbed question interface for better UX. Includes version tracking, scraper maintenance tools (/fix-scraper, /update-scraper), self-contained Kafka notification support, and optional config file pre-configuration.
How to install scraper-dev?
To install scraper-dev, create the .claude/skills directory in your project, then run the curl command to download the skill file. Once installed, invoke it in Claude Code with /scraper-dev.
What is scraper-dev best for?
scraper-dev is a community categorized under Development. It is designed for: api. Created by Mark Johnson.