danielmiessler/lifeos107 installs
scraping
Web scraping via progressive escalation and social media platform scrapers. USE WHEN scraping, crawl, scrape URL, bot detection, CAPTCHA, spider.
How do I install this agent skill?
npx skills add https://github.com/danielmiessler/lifeos --skill scrapingIs this agent skill safe to install?
- Gen Agent Trust Hubpass
The skill describes web scraping techniques which ingest untrusted data from external websites, creating a potential surface for indirect prompt injection attacks.
- Socketpass
No alerts
- Snykwarn
Risk: MEDIUM · 1 issue
What does this agent skill do?
Scraping Skill
Progressive Escalation
- Direct fetch — curl/fetch with standard headers
- Browser rendering — Headless browser for JS-heavy sites
- Proxy rotation — For rate-limited or geo-restricted content
- Specialized APIs — Platform-specific scrapers
Rules
- Respect robots.txt
- Rate limit requests
- Handle pagination
- Extract structured data
- Store raw + processed versions
How can the creator link this skill?
Add the canonical catalog link to the repository README so users can inspect current installs and available audits. The publishing guide covers the complete discovery path.
<a href="https://skillzs.dev/skills/danielmiessler/lifeos/scraping">View scraping on skillZs</a>