/automation--scrape-it-now

/automation--scrape-it-now is a Claude Code skill in the Code section. Sets up and runs a site-wide crawl with scrape-it-now to get clean markdown, locally or on Azure, with optional indexing.

Author's description

Run a site-wide markdown crawl with scrape-it-now — job config, local vs Azure, indexing

How to ask for it

/automation--scrape-it-now crawl my whole site and convert it to markdown
/automation--scrape-it-now configure the scrape-it-now job to run on Azure
/automation--scrape-it-now index the crawled content from my docs site

Install

curl -fsSL https://raw.githubusercontent.com/sgomez-dev/claude-skills/main/install.sh | bash

After installing with the script, type /automation--scrape-it-now. Using Cursor, Windsurf or Codex? Platform guides

Demo coming soon

/automation--scrapegraph-scraperLLM-powered scraper (scrapegraph-ai)
Builds a scraper on scrapegraph-ai where an LLM extracts data into Pydantic schemas, after checking whether the token cost is worth it.
Built here
/automation--spreadsheet-automationSpreadsheet automation
Automates a spreadsheet with formulas, Google Apps Script or Python (openpyxl/pandas) for reliable imports, validation and calculations.
Built here
/automation--web-scraperPolite web scraper
Builds a scraper that checks robots.txt and terms of service, throttles requests, handles pagination and saves results so runs can resume.
Built here
/automation--workflow-automationn8n, Zapier and Make workflows
Designs an n8n, Zapier or Make workflow with trigger, steps and error handling, delivered as an n8n JSON export or a build sheet.
Built here
/cloud--autoscaling-strategyAutoscaling strategy
Designs a service's autoscaling: scaling metric, bounds, cooldowns and cold-start handling, validated with a load test.
Built here
/cloud--aws-architectAWS architecture design
Designs an AWS architecture for your app with a minimal set of services, a Mermaid diagram and a Terraform starter.
Built here

How to ask for it

Install

More from this section